Sep 07 02:08:45 devstack cinder-volume[76328]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 02:08:45 devstack cinder-volume[76328]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 02:08:45 devstack cinder-volume[76328]: we strongly recommend against using it for new projects. Sep 07 02:08:45 devstack cinder-volume[76328]: If you are already using Eventlet, we recommend migrating to a different Sep 07 02:08:45 devstack cinder-volume[76328]: framework. For more detail see Sep 07 02:08:45 devstack cinder-volume[76328]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 02:08:45 devstack cinder-volume[76328]: import eventlet # noqa Sep 07 02:08:48 devstack cinder-volume[76328]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76328) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 02:08:48 devstack cinder-volume[76328]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76328) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 02:08:48 devstack cinder-volume[76328]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76328) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 02:08:49 devstack cinder-volume[76328]: INFO dbcounter [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Registered counter for database cinder Sep 07 02:08:49 devstack cinder-volume[76328]: DEBUG oslo_db.sqlalchemy.engines [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76328) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:08:49 devstack cinder-volume[76328]: DEBUG dbcounter [-] [76328] Writer thread running {{(pid=76328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 02:08:49 devstack cinder-volume[76328]: INFO cinder.rpc [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 02:08:49 devstack cinder-volume[76328]: INFO cinder.rpc [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 02:08:49 devstack cinder-volume[76328]: DEBUG oslo_db.sqlalchemy.engines [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76328) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:08:49 devstack cinder-volume[76328]: INFO cinder.volume.manager [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Determined volume DB was empty at startup. Sep 07 02:08:49 devstack cinder-volume[76328]: DEBUG cinder.volume.manager [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76328) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 02:08:49 devstack cinder-volume[76328]: INFO cinder.volume.manager [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 02:08:49 devstack cinder-volume[76328]: WARNING stevedore.named [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 02:08:49 devstack cinder-volume[76328]: WARNING castellan.key_manager [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 02:08:49 devstack cinder-volume[76328]: WARNING cinder.keymgr.conf_key_mgr [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 02:08:49 devstack cinder-volume[76328]: DEBUG cinder.volume.drivers.lvm [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76328) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 07 02:08:49 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] CMD "cinder-rtstool verify" returned: 0 in 0.437s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_db.sqlalchemy.engines [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76328) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:08:50 devstack cinder-volume[76328]: INFO cinder.rpc [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 07 02:08:50 devstack cinder-volume[76328]: INFO cinder.rpc [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 07 02:08:50 devstack cinder-volume[76328]: WARNING stevedore.named [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 02:08:50 devstack cinder-volume[76328]: WARNING castellan.key_manager [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 02:08:50 devstack cinder-volume[76328]: INFO cinder.volume.manager [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_db.sqlalchemy.engines [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76328) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:08:50 devstack cinder-volume[76328]: INFO oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Starting 1 workers Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Started child 76519 {{(pid=76328) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Full set of CONF: {{(pid=76328) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] ******************************************************************************** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Configuration options gathered from: {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] ================================================================================ {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] allow_availability_zone_fallback = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] allow_compression_on_image_upload = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76519]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] allowed_direct_url_schemes = [] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] api_rate_limit = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] auth_strategy = keystone {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] az_cache_duration = 3600 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_availability_zone = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_host = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_name = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_stats_polling_interval = 60 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backup_api_class = cinder.backup.api.API {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backup_name_template = backup-%s {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backup_use_same_host = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backup_use_temp_snapshot = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] chap_password = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] chap_username = {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cinder_internal_tenant_project_id = dd221595a73947f8b7aef1dadc4dcc40 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cinder_internal_tenant_user_id = c36f9614e344416ca20d7230be3971c7 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cloned_volume_same_az = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cluster = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] compression_format = gzip {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] compute_api_class = cinder.compute.nova.API {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] config_dir = [] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] config_source = [] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] control_exchange = openstack {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] debug = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] default_availability_zone = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] default_group_type = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] default_volume_type = lvmdriver-1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] disk_geometry = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] driver_client_cert = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] driver_client_cert_key = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] driver_data_namespace = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] driver_ssl_cert_path = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] driver_ssl_cert_verify = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] driver_use_ssl = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] enable_force_upload = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] enable_new_services = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] enable_unsupported_driver = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] enabled_backends = ['lvmdriver-1'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] enforce_multipath_for_image_xfer = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] filter_function = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance_api_insecure = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance_api_servers = ['http://192.168.122.234/image'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance_api_ssl_compression = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance_ca_certificates_file = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance_catalog_info = image:glance:publicURL {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance_certfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance_keyfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance_num_retries = 3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance_request_timeout = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] goodness_function = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] graceful_shutdown_timeout = 5 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] group_api_class = cinder.group.api.API {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] host = devstack {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] image_compress_on_upload = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] image_conversion_address_space_limit = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] image_conversion_cpu_limit = 60 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] image_conversion_disable = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] image_upload_use_cinder_backend = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] image_upload_use_internal_tenant = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] image_volume_cache_enabled = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] image_volume_cache_max_count = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] image_volume_cache_max_size_gb = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] init_host_max_objects_retrieval = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] instance_format = [instance: %(uuid)s] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] iscsi_target_flags = {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] iscsi_write_cache = on {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] iser_helper = tgtadm {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] iser_ip_address = 192.168.122.234 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] iser_port = 3260 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] log_color = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] log_config_append = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] log_dir = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] log_file = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] log_options = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] log_rotate_interval = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] log_rotate_interval_type = days {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] log_rotation_type = none {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] max_age = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] max_logfile_count = 30 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] max_logfile_size_mb = 200 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] max_over_subscription_ratio = 20.0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] message_reap_interval = 86400 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] message_ttl = 2592000 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] migration_create_volume_timeout_secs = 300 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] monkey_patch = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] monkey_patch_modules = [] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] my_ip = 192.168.122.234 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] no_snapshot_gb_quota = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] num_iser_scan_tries = 3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] num_shell_tries = 3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] num_volume_device_scan_tries = 3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] nvmeof_conn_info_version = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] nvmet_ns_id = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] nvmet_port_id = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] osapi_max_limit = 1000 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] osapi_volume_ext_list = [] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] osapi_volume_listen = 0.0.0.0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] osapi_volume_listen_port = 8776 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] osapi_volume_use_ssl = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] osapi_volume_workers = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76519]: INFO cinder.volume.manager [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 07 02:08:50 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] per_volume_size_limit = -1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] periodic_fuzzy_delay = 60 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] periodic_interval = 60 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] project_id_regex = [0-9a-f\-]+ {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] public_endpoint = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] publish_errors = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] quota_backup_gigabytes = 1000 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] quota_backups = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] quota_gigabytes = 1000 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] quota_groups = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] quota_snapshots = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] quota_volumes = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] rate_limit_burst = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] rate_limit_except_level = CRITICAL {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] rate_limit_interval = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] reinit_driver_count = 3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] replication_device = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] report_discard_supported = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] report_interval = 120 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] reservation_clean_interval = 86400 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] reservation_expire = 86400 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] reserved_image_namespaces = [] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] reserved_percentage = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] rpc_response_timeout = 120 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] run_external_periodic_tasks = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] scst_target_driver = iscsi {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] scst_target_iqn_name = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_down_time = 720 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] shell_completion = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] snapshot_name_template = snapshot-%s {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] snapshot_same_host = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] split_loggers = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] state_path = /opt/stack/data/cinder {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] storage_availability_zone = nova {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] storage_protocol = iSCSI {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] syslog_log_facility = LOG_USER {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] target_helper = lioadm {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] target_ip_address = 192.168.122.234 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] target_port = 3260 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] target_protocol = iscsi {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] target_secondary_ip_addresses = [] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] trace_flags = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] transfer_api_class = cinder.transfer.api.API {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] transport_url = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] until_refresh = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] use_chap_auth = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] use_default_quota_class = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] use_journal = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] use_json = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] use_multipath_for_image_xfer = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] use_stderr = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] use_syslog = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] verify_glance_signatures = enabled {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_api_class = cinder.volume.api.API {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_backend_name = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_clear = zero {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_clear_ionice = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_clear_size = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_copy_bps_limit = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_dd_blocksize = 1M {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_name_template = volume-%s {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_service_inithost_offload = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volume_usage_audit_period = month {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] zoning_mode = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_concurrency.disable_process_locking = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.auth_section = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.auth_type = password {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.auth_version = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.cache = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.certfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.delay_auth_decision = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.http_connect_timeout = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.include_service_catalog = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.insecure = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.interface = public {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.keyfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_password = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:50 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcache_username = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.region_name = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.service_token_roles_required = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.service_type = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.token_cache_time = 300 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.234/identity {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.backend = dogpile.cache.null {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.backend_argument = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.backend_expiration_time = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.config_prefix = cache.oslo {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.debug_cache_backend = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.enable_retry_client = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.enable_socket_keepalive = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.enabled = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.expiration_time = 600 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.hashclient_retry_attempts = 2 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.memcache_dead_retry = 300 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.memcache_pool_maxsize = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.memcache_sasl_enabled = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.password = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.proxies = [] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.redis_db = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.redis_sentinel_service_name = mymaster {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.redis_server = localhost:6379 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.retry_attempts = 2 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.retry_delay = 0.0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:50 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.socket_keepalive_count = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.socket_keepalive_idle = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.socket_keepalive_interval = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.socket_timeout = 1.0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.tls_allowed_ciphers = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.tls_cafile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.tls_certfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.tls_enabled = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.tls_keyfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cache.username = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] coordination.backend_url = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.asyncio_connection = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.asyncio_slave_connection = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.backend = sqlalchemy {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.connection = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.connection_debug = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.connection_parameters = {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.connection_recycle_time = 3600 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.connection_trace = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.db_inc_retry_interval = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.db_max_retries = 20 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.db_max_retry_interval = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.db_retry_interval = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.max_overflow = 50 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.max_pool_size = 5 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.max_retries = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.mysql_wsrep_sync_wait = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.pool_timeout = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.retry_interval = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.slave_connection = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.sqlite_synchronous = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.synchronous_reader = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] database.use_db_reconnect = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_tracing.insecure = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler.connection_string = messaging:// {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler.enabled = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler.es_doc_type = notification {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler.es_scroll_size = 10000 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler.es_scroll_time = 2m {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler.filter_error_trace = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler.hmac_keys = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler.sentinel_service_name = mymaster {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler.socket_timeout = 0.1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler.trace_requests = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler.trace_sqlalchemy = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler_jaeger.process_tags = {} {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler_jaeger.service_name_prefix = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] profiler_otlp.service_name_prefix = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_policy.enforce_new_defaults = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_policy.policy_default_rule = default {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_policy.policy_file = policy.yaml {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_policy.remote_timeout = 60.0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] privsep_osbrick.group = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] privsep_osbrick.helper_command = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] privsep_osbrick.user = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cinder_sys_admin.group = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cinder_sys_admin.helper_command = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] cinder_sys_admin.user = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.auth_section = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.auth_type = password {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.cafile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.certfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.collect_timing = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.insecure = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.keyfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.send_service_user_token = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.split_loggers = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.timeout = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.tls_ciphers = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] service_user.tls_min_version = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.auth_section = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.auth_type = password {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.certfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.collect_timing = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.insecure = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:50 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.keyfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.region_name = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.split_loggers = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.timeout = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.tls_ciphers = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] glance.tls_min_version = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.backend_availability_zone = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.chap_password = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.chap_username = {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.disk_geometry = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.driver_client_cert = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.driver_client_cert_key = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.driver_data_namespace = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.driver_use_ssl = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.enable_unsupported_driver = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.extra_capabilities = {} {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.filter_function = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.goodness_function = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.iscsi_target_flags = {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.iscsi_write_cache = on {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.iser_helper = tgtadm {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.iser_ip_address = 192.168.122.234 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.iser_port = 3260 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.lvm_mirrors = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.lvm_share_target = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.lvm_type = auto {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.num_shell_tries = 3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.nvmet_port_id = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.replication_device = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.report_discard_supported = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.reserved_percentage = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.scst_target_driver = iscsi {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.scst_target_iqn_name = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.storage_protocol = iSCSI {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.target_helper = tgtadm {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.target_ip_address = 192.168.122.234 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.target_port = 3260 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.target_protocol = iscsi {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.trace_flags = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.unique_fqdn_network = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.use_chap_auth = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.volume_backend_name = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.volume_clear = zero {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.volume_clear_ionice = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.volume_clear_size = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.volume_group = cinder-volumes {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_reports.file_event_handler = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_reports.log_dir = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.backend_availability_zone = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.backend_host = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.chap_password = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.chap_username = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.chiscsi_conf = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.disk_geometry = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.driver_client_cert = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.driver_data_namespace = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.driver_use_ssl = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.extra_capabilities = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.filter_function = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.goodness_function = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.iser_helper = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.iser_ip_address = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.iser_port = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.iser_target_prefix = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.lvm_conf_file = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.lvm_mirrors = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.lvm_share_target = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.lvm_type = auto {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.num_shell_tries = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.nvmet_port_id = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.replication_device = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.report_discard_supported = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.reserved_percentage = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.scst_target_driver = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.storage_protocol = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.target_helper = lioadm {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.target_ip_address = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.target_port = 3260 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.target_protocol = iscsi {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.trace_flags = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.use_chap_auth = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.volume_clear = zero {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.volume_clear_size = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] lvmdriver-1.volumes_dir = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack sudo[76526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack sudo[76526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.ssl = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.ssl_version = {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_notifications.driver = [] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_notifications.retry = -1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] oslo_messaging_notifications.transport_url = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] key_manager.fixed_key = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.barbican_api_version = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.barbican_endpoint = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.barbican_endpoint_type = public {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.barbican_region_name = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.cafile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.certfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.collect_timing = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.insecure = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.keyfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.number_of_retries = 60 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.retry_delay = 1 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.send_service_user_token = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.split_loggers = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.timeout = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.tls_ciphers = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.tls_min_version = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.verify_ssl = True {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican.verify_ssl_path = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican_service_user.auth_section = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican_service_user.auth_type = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican_service_user.cafile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican_service_user.certfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican_service_user.collect_timing = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican_service_user.insecure = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican_service_user.keyfile = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican_service_user.split_loggers = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican_service_user.timeout = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican_service_user.tls_ciphers = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] barbican_service_user.tls_min_version = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.approle_role_id = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.approle_secret_id = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.auth_method = approle {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.auth_path = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.kv_mountpoint = secret {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.kv_path = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.kv_version = 2 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.namespace = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.root_token_id = **** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.ssl_ca_crt_file = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.timeout = 60.0 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.token_file = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.token_role = None {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.use_ssl = False {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:08:50 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] ******************************************************************************** {{(pid=76328) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 02:08:50 devstack sudo[76526]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:50 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:50 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:50 devstack sudo[76580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:08:50 devstack sudo[76580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:51 devstack sudo[76580]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:51 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.324s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:51 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:08:51 devstack cinder-volume[76519]: INFO cinder.brick.local_dev.lvm [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 07 02:08:51 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:51 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:51 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:51 devstack sudo[76710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 02:08:51 devstack sudo[76710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:51 devstack sudo[76710]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:51 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:51 devstack cinder-volume[76519]: DEBUG cinder.brick.local_dev.lvm [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76519) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 07 02:08:51 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:51 devstack sudo[76789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:08:51 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:52 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:52 devstack sudo[76982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:08:52 devstack sudo[76982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:52 devstack sudo[76982]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:52 devstack sudo[77059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 07 02:08:52 devstack sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:52 devstack sudo[77059]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.306s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:52 devstack sudo[77138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 02:08:52 devstack sudo[77138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:52 devstack sudo[77138]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:52 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:53 devstack sudo[77145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 02:08:53 devstack sudo[77145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:53 devstack sudo[77145]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:53 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:53 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:53 devstack sudo[77225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:08:53 devstack sudo[77225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:53 devstack sudo[77225]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:53 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:53 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:53 devstack sudo[77233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:08:53 devstack sudo[77233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:53 devstack sudo[77233]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:53 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:53 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:53 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:53 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:53 devstack sudo[77318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:08:53 devstack sudo[77318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:54 devstack sudo[77318]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:54 devstack cinder-volume[76519]: INFO cinder.volume.drivers.lvm [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 07 02:08:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:54 devstack sudo[77322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:08:54 devstack sudo[77322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:54 devstack sudo[77322]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:54 devstack cinder-volume[76519]: DEBUG cinder.volume.drivers.lvm [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Updating volume stats {{(pid=76519) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 02:08:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:54 devstack sudo[77331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 02:08:54 devstack sudo[77331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:54 devstack sudo[77331]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:54 devstack sudo[77334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:08:54 devstack sudo[77334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:55 devstack sudo[77334]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:55 devstack sudo[77337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:08:55 devstack sudo[77337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:55 devstack sudo[77337]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:55 devstack sudo[77340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:08:55 devstack sudo[77340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:55 devstack sudo[77340]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:55 devstack cinder-volume[76519]: INFO cinder.volume.driver [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Driver hasn't implemented _init_vendor_properties() Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG cinder.volume.driver [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76519) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG oslo_db.sqlalchemy.engines [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76519) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG dbcounter [-] [76519] Writer thread running {{(pid=76519) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG cinder.db.api [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Building query based on filter {{(pid=76519) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG cinder.image.image_utils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76519) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 02:08:55 devstack cinder-volume[76519]: INFO cinder.keymgr.migration [None req-500df81b-4ac6-49f7-a805-d390ffce8489 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG cinder.volume.drivers.lvm [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Updating volume stats {{(pid=76519) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:55 devstack sudo[77343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 02:08:55 devstack sudo[77343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:55 devstack sudo[77343]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:56 devstack sudo[77347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:08:56 devstack sudo[77347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:56 devstack sudo[77347]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:56 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:56 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:56 devstack sudo[77351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:08:56 devstack sudo[77351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:56 devstack sudo[77351]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:56 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:56 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:56 devstack sudo[77355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:08:56 devstack sudo[77355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:56 devstack sudo[77355]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:56 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:56 devstack cinder-volume[76519]: DEBUG cinder.manager [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Notifying Schedulers of capabilities ... {{(pid=76519) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:08:56 devstack cinder-volume[76519]: INFO cinder.volume.manager [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Driver initialization completed successfully. Sep 07 02:08:56 devstack cinder-volume[76519]: INFO cinder.manager [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Initiating service 2 cleanup Sep 07 02:08:56 devstack cinder-volume[76519]: INFO cinder.manager [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Service 2 cleanup completed. Sep 07 02:08:56 devstack cinder-volume[76519]: DEBUG cinder.service [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Creating RPC server for service cinder-volume {{(pid=76519) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 02:08:56 devstack cinder-volume[76519]: DEBUG cinder.service [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76519) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 02:08:56 devstack cinder-volume[76519]: INFO cinder.volume.manager [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 07 02:08:56 devstack cinder-volume[76519]: DEBUG cinder.volume.drivers.lvm [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Updating volume stats {{(pid=76519) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 02:08:56 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:56 devstack sudo[77358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 02:08:56 devstack sudo[77358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:57 devstack sudo[77358]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:57 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:57 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:57 devstack sudo[77361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:08:57 devstack sudo[77361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:57 devstack sudo[77361]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:57 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:57 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:57 devstack sudo[77366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:08:57 devstack sudo[77366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:57 devstack sudo[77366]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:57 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:57 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:08:57 devstack sudo[77372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:08:57 devstack sudo[77372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:08:57 devstack sudo[77372]: pam_unix(sudo:session): session closed for user root Sep 07 02:08:57 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:08:57 devstack cinder-volume[76519]: INFO cinder.volume.manager [None req-b336a4e8-623a-4583-b0ea-418336429082 None None] Driver post RPC initialization completed successfully. Sep 07 02:09:00 devstack cinder-volume[76328]: DEBUG dbcounter [-] [76328] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:09:07 devstack cinder-volume[76519]: DEBUG dbcounter [-] [76519] Writing DB stats cinder:SELECT=3 {{(pid=76519) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:09:08 devstack cinder-volume[76519]: DEBUG dbcounter [-] [76519] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76519) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:09:53 devstack cinder-volume[76519]: DEBUG oslo_service.periodic_task [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76519) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:09:54 devstack cinder-volume[76519]: DEBUG cinder.volume.drivers.lvm [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Updating volume stats {{(pid=76519) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 02:09:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:09:54 devstack sudo[79348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 02:09:54 devstack sudo[79348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:09:54 devstack sudo[79348]: pam_unix(sudo:session): session closed for user root Sep 07 02:09:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:09:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:09:54 devstack sudo[79351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:09:54 devstack sudo[79351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:09:54 devstack sudo[79351]: pam_unix(sudo:session): session closed for user root Sep 07 02:09:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:09:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:09:54 devstack sudo[79354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:09:54 devstack sudo[79354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:09:54 devstack sudo[79354]: pam_unix(sudo:session): session closed for user root Sep 07 02:09:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:09:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:09:54 devstack sudo[79357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:09:54 devstack sudo[79357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:09:55 devstack sudo[79357]: pam_unix(sudo:session): session closed for user root Sep 07 02:09:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:09:55 devstack cinder-volume[76519]: DEBUG cinder.manager [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Notifying Schedulers of capabilities ... {{(pid=76519) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:09:55 devstack cinder-volume[76519]: DEBUG oslo_service.periodic_task [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running periodic task VolumeManager._thread_info {{(pid=76519) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:09:55 devstack cinder-volume[76519]: DEBUG cinder.volume.manager [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] thread count: 6 {{(pid=76519) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:09:55 devstack cinder-volume[76519]: DEBUG cinder.volume.manager [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] thread info: [<_MainThread(MainThread, started 130098891694208)>, , , , , ] {{(pid=76519) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:10:54 devstack cinder-volume[76519]: DEBUG oslo_service.periodic_task [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76519) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:10:54 devstack cinder-volume[76519]: DEBUG cinder.volume.drivers.lvm [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Updating volume stats {{(pid=76519) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 02:10:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:10:54 devstack sudo[82653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 02:10:54 devstack sudo[82653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:10:54 devstack sudo[82653]: pam_unix(sudo:session): session closed for user root Sep 07 02:10:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:10:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:10:54 devstack sudo[82657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:10:54 devstack sudo[82657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:10:54 devstack sudo[82657]: pam_unix(sudo:session): session closed for user root Sep 07 02:10:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:10:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:10:54 devstack sudo[82660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:10:54 devstack sudo[82660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:10:54 devstack sudo[82660]: pam_unix(sudo:session): session closed for user root Sep 07 02:10:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:10:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:10:54 devstack sudo[82667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:10:54 devstack sudo[82667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:10:55 devstack sudo[82667]: pam_unix(sudo:session): session closed for user root Sep 07 02:10:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:10:55 devstack cinder-volume[76519]: DEBUG cinder.manager [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Notifying Schedulers of capabilities ... {{(pid=76519) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:10:55 devstack cinder-volume[76519]: DEBUG oslo_service.periodic_task [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running periodic task VolumeManager._thread_info {{(pid=76519) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:10:55 devstack cinder-volume[76519]: DEBUG cinder.volume.manager [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] thread count: 6 {{(pid=76519) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:10:55 devstack cinder-volume[76519]: DEBUG cinder.volume.manager [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] thread info: [<_MainThread(MainThread, started 130098891694208)>, , , , , ] {{(pid=76519) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:11:08 devstack cinder-volume[76519]: DEBUG dbcounter [-] [76519] Writing DB stats cinder:SELECT=1 {{(pid=76519) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:11:08 devstack cinder-volume[76519]: DEBUG dbcounter [-] [76519] Writing DB stats cinder:UPDATE=1 {{(pid=76519) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:11:54 devstack cinder-volume[76519]: DEBUG oslo_service.periodic_task [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76519) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:11:54 devstack cinder-volume[76519]: DEBUG cinder.volume.drivers.lvm [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Updating volume stats {{(pid=76519) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 02:11:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:11:54 devstack sudo[84636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 02:11:54 devstack sudo[84636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:11:54 devstack sudo[84636]: pam_unix(sudo:session): session closed for user root Sep 07 02:11:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:11:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:11:54 devstack sudo[84644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:11:54 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:11:54 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root Sep 07 02:11:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:11:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:11:54 devstack sudo[84668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:11:54 devstack sudo[84668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:11:54 devstack sudo[84668]: pam_unix(sudo:session): session closed for user root Sep 07 02:11:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:11:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:11:54 devstack sudo[84672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:11:54 devstack sudo[84672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:11:55 devstack sudo[84672]: pam_unix(sudo:session): session closed for user root Sep 07 02:11:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:11:55 devstack cinder-volume[76519]: DEBUG cinder.manager [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Notifying Schedulers of capabilities ... {{(pid=76519) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:12:54 devstack cinder-volume[76519]: DEBUG oslo_service.periodic_task [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76519) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:12:54 devstack cinder-volume[76519]: DEBUG cinder.volume.drivers.lvm [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Updating volume stats {{(pid=76519) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 02:12:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:12:54 devstack sudo[85897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 02:12:54 devstack sudo[85897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:12:54 devstack sudo[85897]: pam_unix(sudo:session): session closed for user root Sep 07 02:12:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:12:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:12:54 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:12:54 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:12:54 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Sep 07 02:12:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:12:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:12:54 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 02:12:54 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:12:54 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Sep 07 02:12:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:12:54 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:12:54 devstack sudo[85909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 02:12:54 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:12:55 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root Sep 07 02:12:55 devstack cinder-volume[76519]: DEBUG oslo_concurrency.processutils [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76519) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:12:55 devstack cinder-volume[76519]: DEBUG cinder.manager [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Notifying Schedulers of capabilities ... {{(pid=76519) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:12:55 devstack cinder-volume[76519]: DEBUG oslo_service.periodic_task [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] Running periodic task VolumeManager._thread_info {{(pid=76519) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:12:55 devstack cinder-volume[76519]: DEBUG cinder.volume.manager [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] thread count: 6 {{(pid=76519) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:12:55 devstack cinder-volume[76519]: DEBUG cinder.volume.manager [None req-b38ba76b-1541-49c8-9ca2-089025cbfc56 None None] thread info: [<_MainThread(MainThread, started 130098891694208)>, , , , , ] {{(pid=76519) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:13:08 devstack cinder-volume[76519]: DEBUG dbcounter [-] [76519] Writing DB stats cinder:SELECT=1 {{(pid=76519) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:13:08 devstack cinder-volume[76519]: DEBUG dbcounter [-] [76519] Writing DB stats cinder:UPDATE=1 {{(pid=76519) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:13:17 devstack cinder-volume[76328]: INFO oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Caught SIGTERM, stopping children Sep 07 02:13:17 devstack cinder-volume[76328]: DEBUG oslo_concurrency.lockutils [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Acquiring lock "singleton_lock" {{(pid=76328) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 02:13:17 devstack cinder-volume[76328]: DEBUG oslo_concurrency.lockutils [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Acquired lock "singleton_lock" {{(pid=76328) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 02:13:17 devstack cinder-volume[76328]: DEBUG oslo_concurrency.lockutils [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Releasing lock "singleton_lock" {{(pid=76328) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 02:13:17 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Stop services. {{(pid=76328) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 02:13:17 devstack cinder-volume[76328]: DEBUG oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Killing children. {{(pid=76328) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 02:13:17 devstack cinder-volume[76328]: INFO oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Waiting on 1 children to exit Sep 07 02:13:21 devstack cinder-volume[76519]: DEBUG oslo_concurrency.lockutils [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Acquiring lock "singleton_lock" {{(pid=76519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 02:13:21 devstack cinder-volume[76519]: DEBUG oslo_concurrency.lockutils [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Acquired lock "singleton_lock" {{(pid=76519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 02:13:21 devstack cinder-volume[76519]: DEBUG oslo_concurrency.lockutils [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Releasing lock "singleton_lock" {{(pid=76519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 02:13:21 devstack cinder-volume[76519]: WARNING amqp [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 02:13:21 devstack cinder-volume[76519]: WARNING amqp [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 02:13:21 devstack cinder-volume[76328]: INFO oslo_service.backend._eventlet.service [None req-c3aeb2fd-d14a-438d-b136-b3435b5d143e None None] Child 76519 exited with status 0 Sep 07 02:13:22 devstack cinder-volume[86512]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 02:13:22 devstack cinder-volume[86512]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 02:13:22 devstack cinder-volume[86512]: we strongly recommend against using it for new projects. Sep 07 02:13:22 devstack cinder-volume[86512]: If you are already using Eventlet, we recommend migrating to a different Sep 07 02:13:22 devstack cinder-volume[86512]: framework. For more detail see Sep 07 02:13:22 devstack cinder-volume[86512]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 02:13:22 devstack cinder-volume[86512]: import eventlet # noqa Sep 07 02:13:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 02:13:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 02:13:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 02:13:25 devstack cinder-volume[86512]: INFO dbcounter [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Registered counter for database cinder Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_db.sqlalchemy.engines [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writer thread running {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 02:13:25 devstack cinder-volume[86512]: INFO cinder.rpc [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 02:13:25 devstack cinder-volume[86512]: INFO cinder.rpc [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_db.sqlalchemy.engines [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:13:25 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Determined volume DB was empty at startup. Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86512) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 02:13:25 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 02:13:25 devstack cinder-volume[86512]: WARNING stevedore.named [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 02:13:25 devstack cinder-volume[86512]: WARNING castellan.key_manager [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 02:13:25 devstack cinder-volume[86512]: WARNING cinder.keymgr.conf_key_mgr [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 02:13:25 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_db.sqlalchemy.engines [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:13:25 devstack cinder-volume[86512]: INFO oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Starting 1 workers Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Started child 86729 {{(pid=86512) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Full set of CONF: {{(pid=86512) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] ******************************************************************************** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Configuration options gathered from: {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] ================================================================================ {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 02:13:25 devstack cinder-volume[86729]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] allow_availability_zone_fallback = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] allow_compression_on_image_upload = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] allowed_direct_url_schemes = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] api_rate_limit = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] auth_strategy = keystone {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_availability_zone = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_host = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_stats_polling_interval = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backup_api_class = cinder.backup.api.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backup_name_template = backup-%s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backup_use_same_host = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backup_use_temp_snapshot = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] chap_password = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] chap_username = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cinder_internal_tenant_project_id = dd221595a73947f8b7aef1dadc4dcc40 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cinder_internal_tenant_user_id = c36f9614e344416ca20d7230be3971c7 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cluster = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] compression_format = gzip {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] compute_api_class = cinder.compute.nova.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] config_dir = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] config_source = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] control_exchange = openstack {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] debug = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] default_availability_zone = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] default_group_type = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] default_volume_type = QuobyteHD {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] disk_geometry = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] driver_client_cert = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] driver_client_cert_key = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] driver_data_namespace = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] driver_ssl_cert_path = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] driver_ssl_cert_verify = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] driver_use_ssl = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] enable_new_services = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] enable_unsupported_driver = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] enabled_backends = ['QuobyteHD'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] enforce_multipath_for_image_xfer = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] filter_function = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance_api_insecure = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance_api_servers = ['http://192.168.122.234/image'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance_api_ssl_compression = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance_ca_certificates_file = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance_catalog_info = image:glance:publicURL {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance_certfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance_keyfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance_num_retries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance_request_timeout = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] goodness_function = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] graceful_shutdown_timeout = 5 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] group_api_class = cinder.group.api.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] host = devstack {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] image_compress_on_upload = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] image_conversion_address_space_limit = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] image_conversion_cpu_limit = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] image_conversion_disable = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] image_upload_use_cinder_backend = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] image_upload_use_internal_tenant = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] image_volume_cache_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] image_volume_cache_max_count = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] image_volume_cache_max_size_gb = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] init_host_max_objects_retrieval = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] instance_format = [instance: %(uuid)s] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] iscsi_target_flags = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] iscsi_write_cache = on {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] iser_helper = tgtadm {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] iser_ip_address = 192.168.122.234 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] iser_port = 3260 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] log_color = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] log_config_append = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] log_dir = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] log_file = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] log_options = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] log_rotate_interval = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] log_rotate_interval_type = days {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] log_rotation_type = none {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] max_age = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 02:13:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86729) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] max_logfile_count = 30 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] max_logfile_size_mb = 200 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] max_over_subscription_ratio = 20.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] message_reap_interval = 86400 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] message_ttl = 2592000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] migration_create_volume_timeout_secs = 300 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] monkey_patch = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] monkey_patch_modules = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] my_ip = 192.168.122.234 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] no_snapshot_gb_quota = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] num_iser_scan_tries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] num_shell_tries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] num_volume_device_scan_tries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] nvmeof_conn_info_version = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] nvmet_ns_id = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] nvmet_port_id = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] osapi_max_limit = 1000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] osapi_volume_ext_list = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] osapi_volume_listen_port = 8776 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] osapi_volume_use_ssl = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] osapi_volume_workers = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] per_volume_size_limit = -1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] periodic_fuzzy_delay = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] periodic_interval = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] public_endpoint = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] publish_errors = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] quota_backup_gigabytes = 1000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] quota_backups = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] quota_gigabytes = 1000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] quota_groups = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] quota_snapshots = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] quota_volumes = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] rate_limit_burst = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] rate_limit_except_level = CRITICAL {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] rate_limit_interval = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] reinit_driver_count = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] replication_device = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] report_discard_supported = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] report_interval = 120 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] reservation_clean_interval = 86400 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] reservation_expire = 86400 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] reserved_image_namespaces = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] reserved_percentage = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] rpc_response_timeout = 120 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] run_external_periodic_tasks = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] scst_target_driver = iscsi {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] scst_target_iqn_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_down_time = 720 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] shell_completion = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] snapshot_name_template = snapshot-%s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] split_loggers = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] state_path = /opt/stack/data/cinder {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] storage_availability_zone = nova {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] storage_protocol = iSCSI {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] syslog_log_facility = LOG_USER {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] target_helper = lioadm {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] target_ip_address = 192.168.122.234 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] target_port = 3260 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] target_protocol = iscsi {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] target_secondary_ip_addresses = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] trace_flags = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] transport_url = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] until_refresh = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] use_chap_auth = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] use_default_quota_class = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] use_journal = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] use_json = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] use_multipath_for_image_xfer = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] use_stderr = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86729) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 02:13:25 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.quobyte [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 02:13:25 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.quobyte [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] use_syslog = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] verify_glance_signatures = enabled {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Running cmd (subprocess): mount.quobyte {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_api_class = cinder.volume.api.API {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_backend_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_clear = zero {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_clear_ionice = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_clear_size = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_copy_bps_limit = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_dd_blocksize = 1M {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_name_template = volume-%s {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_service_inithost_offload = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volume_usage_audit_period = month {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] zoning_mode = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_concurrency.disable_process_locking = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.auth_section = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.auth_type = password {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.auth_version = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.cache = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.certfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.include_service_catalog = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.insecure = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.interface = public {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.keyfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_password = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcache_username = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.region_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.service_type = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.234/identity {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.backend = dogpile.cache.null {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.backend_argument = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.backend_expiration_time = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.config_prefix = cache.oslo {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.debug_cache_backend = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.enable_retry_client = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.enable_socket_keepalive = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.expiration_time = 600 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.hashclient_retry_attempts = 2 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.memcache_dead_retry = 300 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.memcache_pool_maxsize = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.memcache_sasl_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.password = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.proxies = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:25 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.redis_db = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.redis_server = localhost:6379 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.retry_attempts = 2 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.retry_delay = 0.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.socket_keepalive_count = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.socket_keepalive_idle = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.socket_keepalive_interval = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.socket_timeout = 1.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.tls_allowed_ciphers = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.tls_cafile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.tls_certfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.tls_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.tls_keyfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cache.username = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] coordination.backend_url = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.asyncio_connection = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.asyncio_slave_connection = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.backend = sqlalchemy {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.connection = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.connection_debug = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.connection_parameters = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.connection_recycle_time = 3600 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.connection_trace = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.db_inc_retry_interval = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.db_max_retries = 20 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.db_max_retry_interval = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.db_retry_interval = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.max_overflow = 50 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.max_pool_size = 5 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.max_retries = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.mysql_wsrep_sync_wait = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.pool_timeout = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.retry_interval = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.slave_connection = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.sqlite_synchronous = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.synchronous_reader = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] database.use_db_reconnect = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_tracing.insecure = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler.connection_string = messaging:// {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler.enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler.es_doc_type = notification {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler.es_scroll_size = 10000 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler.es_scroll_time = 2m {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler.filter_error_trace = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler.hmac_keys = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler.sentinel_service_name = mymaster {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler.socket_timeout = 0.1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler.trace_requests = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler.trace_sqlalchemy = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler_jaeger.process_tags = {} {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler_jaeger.service_name_prefix = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] profiler_otlp.service_name_prefix = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_policy.enforce_new_defaults = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_policy.policy_default_rule = default {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_policy.policy_file = policy.yaml {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] privsep_osbrick.group = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] privsep_osbrick.helper_command = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] privsep_osbrick.user = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cinder_sys_admin.group = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cinder_sys_admin.helper_command = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] cinder_sys_admin.user = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.auth_section = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.auth_type = password {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.cafile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.certfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.collect_timing = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.insecure = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.keyfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.send_service_user_token = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.split_loggers = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.timeout = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.tls_ciphers = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] service_user.tls_min_version = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.auth_section = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.auth_type = password {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.certfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.collect_timing = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.insecure = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.keyfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.region_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.split_loggers = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.timeout = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.tls_ciphers = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] glance.tls_min_version = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.backend_availability_zone = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.chap_password = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.chap_username = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.disk_geometry = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.driver_client_cert = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.driver_client_cert_key = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.driver_data_namespace = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.driver_use_ssl = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.extra_capabilities = {} {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.filter_function = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.goodness_function = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.iscsi_target_flags = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.iscsi_write_cache = on {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.iser_helper = tgtadm {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.iser_ip_address = 192.168.122.234 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.iser_port = 3260 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nas_host = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack quobyte-client[86730]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 02:13:26 devstack quobyte-client[86730]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nas_login = admin {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nas_mount_options = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nas_password = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nas_private_key = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nas_share_path = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.num_shell_tries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] CMD "mount.quobyte" returned: 1 in 0.164s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.quobyte_volume_url = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.replication_device = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.report_discard_supported = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.reserved_percentage = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.target_helper = tgtadm {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.target_ip_address = 192.168.122.234 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.target_port = 3260 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86729]: INFO cinder.volume.drivers.quobyte [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 ... Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd -c /etc/quobyte/client-cinder.cfg {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.target_protocol = iscsi {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.trace_flags = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.unique_fqdn_network = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.use_chap_auth = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.volume_backend_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.volume_clear = zero {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.volume_clear_ionice = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.volume_clear_size = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_reports.file_event_handler = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_reports.log_dir = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.backend_availability_zone = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.backend_host = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.chap_password = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.chap_username = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.chiscsi_conf = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.disk_geometry = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.driver_client_cert = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.driver_data_namespace = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.driver_use_ssl = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.extra_capabilities = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.filter_function = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.goodness_function = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.iser_helper = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.iser_ip_address = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.iser_port = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.iser_target_prefix = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nas_host = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nas_login = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nas_mount_options = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nas_password = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nas_private_key = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nas_share_path = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nas_ssh_port = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.num_shell_tries = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.nvmet_port_id = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.replication_device = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.report_discard_supported = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.reserved_percentage = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.scst_target_driver = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.storage_protocol = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.target_helper = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.target_ip_address = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.target_port = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.target_prefix = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.target_protocol = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.trace_flags = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.use_chap_auth = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.volume_clear = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.volume_clear_size = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd -c /etc/quobyte/client-cinder.cfg Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] QuobyteHD.volumes_dir = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.ssl = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_notifications.driver = [] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_notifications.retry = -1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] key_manager.fixed_key = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.barbican_api_version = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.barbican_endpoint = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.barbican_endpoint_type = public {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.barbican_region_name = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.cafile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.certfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.collect_timing = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.insecure = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.keyfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.number_of_retries = 60 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.retry_delay = 1 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.send_service_user_token = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.split_loggers = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.timeout = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.tls_ciphers = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.tls_min_version = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.verify_ssl = True {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican.verify_ssl_path = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican_service_user.auth_section = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican_service_user.auth_type = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican_service_user.cafile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican_service_user.certfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican_service_user.collect_timing = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican_service_user.insecure = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican_service_user.keyfile = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican_service_user.split_loggers = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican_service_user.timeout = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican_service_user.tls_ciphers = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] barbican_service_user.tls_min_version = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.approle_role_id = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.approle_secret_id = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.auth_method = approle {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.auth_path = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.kv_mountpoint = secret {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.kv_path = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.kv_version = 2 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.namespace = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.root_token_id = **** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.ssl_ca_crt_file = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.timeout = 60.0 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.token_file = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.token_role = None {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.use_ssl = False {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:26 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] ******************************************************************************** {{(pid=86512) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 02:13:26 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.397s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:13:26 devstack cinder-volume[86729]: INFO cinder.volume.drivers.quobyte [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 succeeded Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.413s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:13:26 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:13:26 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:13:26 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.242s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:13:26 devstack cinder-volume[86729]: INFO cinder.volume.driver [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Driver hasn't implemented _init_vendor_properties() Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG cinder.volume.driver [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6277351379395, 'free_capacity_gb': 1773.6277351379395, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86729) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_db.sqlalchemy.engines [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86729) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writer thread running {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG cinder.db.api [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Building query based on filter {{(pid=86729) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86729) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 02:13:26 devstack cinder-volume[86729]: INFO cinder.keymgr.migration [None req-c90c70e2-19b4-4a9a-981e-ea535e24d21f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:13:26 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:13:26 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:13:27 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Sep 07 02:13:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.232s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:13:27 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:13:27 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Driver initialization completed successfully. Sep 07 02:13:27 devstack cinder-volume[86729]: INFO cinder.manager [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Initiating service 3 cleanup Sep 07 02:13:27 devstack cinder-volume[86729]: INFO cinder.manager [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Service 3 cleanup completed. Sep 07 02:13:27 devstack cinder-volume[86729]: DEBUG cinder.service [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Creating RPC server for service cinder-volume {{(pid=86729) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 02:13:27 devstack cinder-volume[86729]: DEBUG cinder.service [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86729) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 02:13:27 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 02:13:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:13:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:13:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:13:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:13:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:13:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:13:27 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:13:27 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:13:27 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Sep 07 02:13:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.269s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:13:27 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-650d282a-2519-48d8-88a3-c739503cdf74 None None] Driver post RPC initialization completed successfully. Sep 07 02:13:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5f3a2324-acf9-4d07-a54b-1aa8d242785a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:13:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5f3a2324-acf9-4d07-a54b-1aa8d242785a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:13:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5f3a2324-acf9-4d07-a54b-1aa8d242785a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:13:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5f3a2324-acf9-4d07-a54b-1aa8d242785a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:13:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5f3a2324-acf9-4d07-a54b-1aa8d242785a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:13:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5f3a2324-acf9-4d07-a54b-1aa8d242785a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:13:32 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:13:32 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:13:32 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Sep 07 02:13:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5f3a2324-acf9-4d07-a54b-1aa8d242785a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.225s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:13:32 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-5f3a2324-acf9-4d07-a54b-1aa8d242785a None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:13:32 devstack cinder-volume[86512]: INFO oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Caught SIGTERM, stopping children Sep 07 02:13:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Acquiring lock "singleton_lock" {{(pid=86512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 02:13:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Acquired lock "singleton_lock" {{(pid=86512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 02:13:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Releasing lock "singleton_lock" {{(pid=86512) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 02:13:32 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Stop services. {{(pid=86512) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 02:13:32 devstack cinder-volume[86512]: DEBUG oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Killing children. {{(pid=86512) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 02:13:32 devstack cinder-volume[86512]: INFO oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Waiting on 1 children to exit Sep 07 02:13:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Acquiring lock "singleton_lock" {{(pid=86729) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 02:13:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Acquired lock "singleton_lock" {{(pid=86729) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 02:13:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Releasing lock "singleton_lock" {{(pid=86729) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 02:13:35 devstack cinder-volume[86729]: WARNING amqp [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 02:13:35 devstack cinder-volume[86729]: WARNING amqp [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 02:13:35 devstack cinder-volume[86512]: INFO oslo_service.backend._eventlet.service [None req-c1d2b9bb-f961-41df-abd7-34bf3b1b690b None None] Child 86729 exited with status 0 Sep 07 02:13:36 devstack cinder-volume[87013]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 02:13:36 devstack cinder-volume[87013]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 02:13:36 devstack cinder-volume[87013]: we strongly recommend against using it for new projects. Sep 07 02:13:36 devstack cinder-volume[87013]: If you are already using Eventlet, we recommend migrating to a different Sep 07 02:13:36 devstack cinder-volume[87013]: framework. For more detail see Sep 07 02:13:36 devstack cinder-volume[87013]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 02:13:36 devstack cinder-volume[87013]: import eventlet # noqa Sep 07 02:13:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 02:13:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 02:13:39 devstack cinder-volume[87013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 02:13:40 devstack cinder-volume[87013]: INFO dbcounter [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Registered counter for database cinder Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_db.sqlalchemy.engines [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writer thread running {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 02:13:40 devstack cinder-volume[87013]: INFO cinder.rpc [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 02:13:40 devstack cinder-volume[87013]: INFO cinder.rpc [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_db.sqlalchemy.engines [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:13:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Determined volume DB was empty at startup. Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG cinder.volume.manager [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87013) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 02:13:40 devstack cinder-volume[87013]: WARNING stevedore.named [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 02:13:40 devstack cinder-volume[87013]: WARNING castellan.key_manager [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 02:13:40 devstack cinder-volume[87013]: WARNING cinder.keymgr.conf_key_mgr [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 02:13:40 devstack cinder-volume[87013]: INFO cinder.volume.manager [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_db.sqlalchemy.engines [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:13:40 devstack cinder-volume[87013]: INFO oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Starting 1 workers Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Started child 87313 {{(pid=87013) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Full set of CONF: {{(pid=87013) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] ******************************************************************************** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] Configuration options gathered from: {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] ================================================================================ {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] allow_availability_zone_fallback = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87313]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] allow_compression_on_image_upload = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] allowed_direct_url_schemes = [] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] api_rate_limit = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] auth_strategy = keystone {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_availability_zone = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_host = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_name = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_stats_polling_interval = 60 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backup_api_class = cinder.backup.api.API {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backup_name_template = backup-%s {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backup_use_same_host = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backup_use_temp_snapshot = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] chap_password = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] chap_username = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cinder_internal_tenant_project_id = dd221595a73947f8b7aef1dadc4dcc40 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cinder_internal_tenant_user_id = c36f9614e344416ca20d7230be3971c7 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cluster = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] compression_format = gzip {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] compute_api_class = cinder.compute.nova.API {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] config_dir = [] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] config_source = [] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] control_exchange = openstack {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] debug = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] default_availability_zone = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] default_group_type = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] default_volume_type = QuobyteHD {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] disk_geometry = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] driver_client_cert = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] driver_client_cert_key = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] driver_data_namespace = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] driver_ssl_cert_path = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] driver_ssl_cert_verify = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] driver_use_ssl = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] enable_new_services = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] enable_unsupported_driver = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] enabled_backends = ['QuobyteHD'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] enforce_multipath_for_image_xfer = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] filter_function = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance_api_insecure = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance_api_servers = ['http://192.168.122.234/image'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance_api_ssl_compression = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance_ca_certificates_file = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance_catalog_info = image:glance:publicURL {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance_certfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance_keyfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance_num_retries = 3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance_request_timeout = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] goodness_function = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] graceful_shutdown_timeout = 5 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] group_api_class = cinder.group.api.API {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] host = devstack {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] image_compress_on_upload = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] image_conversion_address_space_limit = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] image_conversion_cpu_limit = 60 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] image_conversion_disable = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] image_upload_use_cinder_backend = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] image_upload_use_internal_tenant = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] image_volume_cache_enabled = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] image_volume_cache_max_count = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] image_volume_cache_max_size_gb = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] init_host_max_objects_retrieval = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] instance_format = [instance: %(uuid)s] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] iscsi_target_flags = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] iscsi_write_cache = on {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] iser_helper = tgtadm {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] iser_ip_address = 192.168.122.234 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] iser_port = 3260 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] log_color = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] log_config_append = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] log_dir = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] log_file = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] log_options = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] log_rotate_interval = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] log_rotate_interval_type = days {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] log_rotation_type = none {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] max_age = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] max_logfile_count = 30 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] max_logfile_size_mb = 200 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] max_over_subscription_ratio = 20.0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] message_reap_interval = 86400 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] message_ttl = 2592000 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] migration_create_volume_timeout_secs = 300 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] monkey_patch = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] monkey_patch_modules = [] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] my_ip = 192.168.122.234 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] no_snapshot_gb_quota = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] num_iser_scan_tries = 3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] num_shell_tries = 3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] num_volume_device_scan_tries = 3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] nvmeof_conn_info_version = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] nvmet_ns_id = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] nvmet_port_id = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] osapi_max_limit = 1000 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] osapi_volume_ext_list = [] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] osapi_volume_listen = 0.0.0.0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] osapi_volume_listen_port = 8776 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] osapi_volume_use_ssl = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] osapi_volume_workers = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] per_volume_size_limit = -1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] periodic_fuzzy_delay = 60 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] periodic_interval = 60 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] project_id_regex = [0-9a-f\-]+ {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] public_endpoint = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] publish_errors = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] quota_backup_gigabytes = 1000 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] quota_backups = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] quota_gigabytes = 1000 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] quota_groups = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] quota_snapshots = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] quota_volumes = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] rate_limit_burst = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] rate_limit_except_level = CRITICAL {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] rate_limit_interval = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] reinit_driver_count = 3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] replication_device = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] report_discard_supported = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] report_interval = 120 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] reservation_clean_interval = 86400 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] reservation_expire = 86400 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87313) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] reserved_image_namespaces = [] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] reserved_percentage = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] rpc_response_timeout = 120 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] run_external_periodic_tasks = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] scst_target_driver = iscsi {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] scst_target_iqn_name = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_down_time = 720 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] shell_completion = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] snapshot_name_template = snapshot-%s {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] split_loggers = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] state_path = /opt/stack/data/cinder {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] storage_availability_zone = nova {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] storage_protocol = iSCSI {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] syslog_log_facility = LOG_USER {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] target_helper = lioadm {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] target_ip_address = 192.168.122.234 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] target_port = 3260 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] target_protocol = iscsi {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] target_secondary_ip_addresses = [] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] trace_flags = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] transfer_api_class = cinder.transfer.api.API {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] transport_url = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] until_refresh = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] use_chap_auth = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] use_default_quota_class = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] use_journal = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] use_json = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] use_multipath_for_image_xfer = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] use_stderr = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] use_syslog = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] verify_glance_signatures = enabled {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_api_class = cinder.volume.api.API {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_backend_name = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_clear = zero {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_clear_ionice = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_clear_size = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_copy_bps_limit = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_dd_blocksize = 1M {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_name_template = volume-%s {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_service_inithost_offload = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volume_usage_audit_period = month {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] zoning_mode = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_concurrency.disable_process_locking = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.auth_section = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.auth_type = password {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.auth_version = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.cache = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.certfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.delay_auth_decision = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.http_connect_timeout = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.include_service_catalog = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.insecure = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.interface = public {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.keyfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_password = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcache_username = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.region_name = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.service_token_roles_required = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.service_type = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.token_cache_time = 300 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.234/identity {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.backend = dogpile.cache.null {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.backend_argument = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.backend_expiration_time = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.config_prefix = cache.oslo {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.debug_cache_backend = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.enable_retry_client = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.enable_socket_keepalive = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.enabled = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.expiration_time = 600 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.hashclient_retry_attempts = 2 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:40 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.memcache_dead_retry = 300 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.memcache_pool_maxsize = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.memcache_sasl_enabled = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.password = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.proxies = [] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.redis_db = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.redis_sentinel_service_name = mymaster {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87313) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 02:13:41 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.quobyte [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 02:13:41 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.quobyte [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.redis_server = localhost:6379 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Running cmd (subprocess): mount.quobyte {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.retry_attempts = 2 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.retry_delay = 0.0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.socket_keepalive_count = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.socket_keepalive_idle = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.socket_keepalive_interval = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.socket_timeout = 1.0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.tls_allowed_ciphers = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.tls_cafile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.tls_certfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.tls_enabled = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.tls_keyfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cache.username = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] coordination.backend_url = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.asyncio_connection = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.asyncio_slave_connection = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.backend = sqlalchemy {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.connection = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.connection_debug = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.connection_parameters = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.connection_recycle_time = 3600 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.connection_trace = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.db_inc_retry_interval = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.db_max_retries = 20 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.db_max_retry_interval = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.db_retry_interval = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.max_overflow = 50 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.max_pool_size = 5 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.max_retries = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.mysql_wsrep_sync_wait = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.pool_timeout = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.retry_interval = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.slave_connection = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.sqlite_synchronous = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.synchronous_reader = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] database.use_db_reconnect = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_tracing.insecure = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler.connection_string = messaging:// {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler.enabled = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler.es_doc_type = notification {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler.es_scroll_size = 10000 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler.es_scroll_time = 2m {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler.filter_error_trace = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler.hmac_keys = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler.sentinel_service_name = mymaster {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler.socket_timeout = 0.1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler.trace_requests = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler.trace_sqlalchemy = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler_jaeger.process_tags = {} {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler_jaeger.service_name_prefix = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] profiler_otlp.service_name_prefix = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_policy.enforce_new_defaults = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_policy.policy_default_rule = default {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_policy.policy_file = policy.yaml {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_policy.remote_timeout = 60.0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] privsep_osbrick.group = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] privsep_osbrick.helper_command = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] privsep_osbrick.user = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cinder_sys_admin.group = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cinder_sys_admin.helper_command = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] cinder_sys_admin.user = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.auth_section = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.auth_type = password {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.cafile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.certfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.collect_timing = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.insecure = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.keyfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.send_service_user_token = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.split_loggers = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.timeout = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.tls_ciphers = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] service_user.tls_min_version = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.auth_section = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.auth_type = password {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.certfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.collect_timing = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.insecure = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] CMD "mount.quobyte" returned: 1 in 0.047s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.keyfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.region_name = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.split_loggers = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.timeout = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.tls_ciphers = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] glance.tls_min_version = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.backend_availability_zone = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.chap_password = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.chap_username = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.disk_geometry = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.driver_client_cert = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.driver_client_cert_key = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.driver_data_namespace = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.driver_use_ssl = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.enable_unsupported_driver = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.extra_capabilities = {} {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.filter_function = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.goodness_function = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.iscsi_target_flags = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.iscsi_write_cache = on {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.iser_helper = tgtadm {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.iser_ip_address = 192.168.122.234 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.iser_port = 3260 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nas_host = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nas_login = admin {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nas_mount_options = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nas_password = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nas_private_key = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nas_share_path = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nas_ssh_port = 22 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.num_shell_tries = 3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.nvmet_port_id = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.quobyte_client_cfg = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.quobyte_volume_url = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.replication_device = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.report_discard_supported = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.reserved_percentage = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.scst_target_driver = iscsi {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.scst_target_iqn_name = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.storage_protocol = iSCSI {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.target_helper = tgtadm {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.target_ip_address = 192.168.122.234 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.target_port = 3260 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.target_protocol = iscsi {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.trace_flags = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.unique_fqdn_network = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.use_chap_auth = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.volume_backend_name = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.volume_clear = zero {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.volume_clear_ionice = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.volume_clear_size = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_reports.file_event_handler = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_reports.log_dir = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.backend_availability_zone = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.backend_host = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.chap_password = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.chap_username = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.chiscsi_conf = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.disk_geometry = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.driver_client_cert = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.driver_client_cert_key = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.driver_data_namespace = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.driver_use_ssl = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.extra_capabilities = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.filter_function = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.goodness_function = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.iscsi_target_flags = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.iscsi_write_cache = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.iser_helper = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.iser_ip_address = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.iser_port = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.iser_target_prefix = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nas_host = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nas_login = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nas_mount_options = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nas_password = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nas_private_key = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nas_share_path = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nas_ssh_port = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.num_shell_tries = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nvmet_ns_id = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.nvmet_port_id = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.replication_device = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.report_discard_supported = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.reserved_percentage = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.scst_target_driver = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.storage_protocol = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.target_helper = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.target_ip_address = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.target_port = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.target_prefix = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.target_protocol = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.trace_flags = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.unique_fqdn_network = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.use_chap_auth = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.volume_clear = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.volume_clear_ionice = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.volume_clear_size = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] QuobyteHD.volumes_dir = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.ssl = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.ssl_version = {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_notifications.driver = [] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_notifications.retry = -1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] oslo_messaging_notifications.transport_url = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] key_manager.fixed_key = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.barbican_api_version = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.barbican_endpoint = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.barbican_endpoint_type = public {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.barbican_region_name = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.cafile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.certfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.collect_timing = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.insecure = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.keyfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.number_of_retries = 60 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.retry_delay = 1 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.send_service_user_token = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.split_loggers = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.timeout = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.tls_ciphers = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.tls_min_version = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.verify_ssl = True {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican.verify_ssl_path = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican_service_user.auth_section = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican_service_user.auth_type = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican_service_user.cafile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican_service_user.certfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican_service_user.collect_timing = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican_service_user.insecure = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican_service_user.keyfile = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican_service_user.split_loggers = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican_service_user.timeout = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican_service_user.tls_ciphers = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] barbican_service_user.tls_min_version = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.approle_role_id = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.approle_secret_id = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.auth_method = approle {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.auth_path = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.kv_mountpoint = secret {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.kv_path = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.kv_version = 2 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.namespace = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.root_token_id = **** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.ssl_ca_crt_file = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.timeout = 60.0 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.token_file = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.token_role = None {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.use_ssl = False {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 02:13:41 devstack cinder-volume[87013]: DEBUG oslo_service.backend._eventlet.service [None req-360a0281-0a1f-46d3-84be-7064a3c9cfab None None] ******************************************************************************** {{(pid=87013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 02:13:41 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.274s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:13:41 devstack cinder-volume[87313]: INFO cinder.volume.driver [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Driver hasn't implemented _init_vendor_properties() Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.volume.driver [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6277351379395, 'free_capacity_gb': 1773.6277351379395, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87313) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_db.sqlalchemy.engines [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87313) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writer thread running {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.db.api [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Building query based on filter {{(pid=87313) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87313) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:13:41 devstack cinder-volume[87313]: INFO cinder.keymgr.migration [None req-0f709355-aa06-4643-b9c7-496437ffe5d0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 02:13:41 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:13:41 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:13:41 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.241s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:13:41 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Driver initialization completed successfully. Sep 07 02:13:41 devstack cinder-volume[87313]: INFO cinder.manager [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Initiating service 3 cleanup Sep 07 02:13:41 devstack cinder-volume[87313]: INFO cinder.manager [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Service 3 cleanup completed. Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.service [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Creating RPC server for service cinder-volume {{(pid=87313) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.service [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87313) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 02:13:41 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:13:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:13:41 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:13:41 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:13:42 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Sep 07 02:13:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:13:42 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2eb42af7-b3df-49f1-9ba4-b30720ee7106 None None] Driver post RPC initialization completed successfully. Sep 07 02:13:50 devstack cinder-volume[87013]: DEBUG dbcounter [-] [87013] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:13:51 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=2 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:13:52 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:14:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:14:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 6 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:14:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:14:40 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:14:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Flow 'volume_create_manager' (df9da7c8-668c-49c3-89b4-5d750917b53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:14:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd89ad77-7648-4936-8ae7-97bfe951549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd89ad77-7648-4936-8ae7-97bfe951549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1381525778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab16aa8-fd5f-4929-b502-4597fb232562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c921ca9ba234e06b8e2dfd56d309c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:14:41Z,use_quota=True,user_id='0e0eb9778bbb471997c4864ebce38ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7311b6a-d251-43a7-9db2-cea473db484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7311b6a-d251-43a7-9db2-cea473db484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6290cfdb-7c30-4a88-97f8-294f6405b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6290cfdb-7c30-4a88-97f8-294f6405b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab16aa8-fd5f-4929-b502-4597fb232562', 'volume_name': 'volume-dab16aa8-fd5f-4929-b502-4597fb232562', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008f080c-bd04-411d-b9e7-ed2416314227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008f080c-bd04-411d-b9e7-ed2416314227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d35b47-df34-4a71-8168-b1aaa94d3d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:41 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Volume dab16aa8-fd5f-4929-b502-4597fb232562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab16aa8-fd5f-4929-b502-4597fb232562', 'volume_size': 1} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1381525778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab16aa8-fd5f-4929-b502-4597fb232562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c921ca9ba234e06b8e2dfd56d309c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:14:41Z,use_quota=True,user_id='0e0eb9778bbb471997c4864ebce38ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Creating volume dab16aa8-fd5f-4929-b502-4597fb232562 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:14:41 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:14:41 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562 1073741824 Sep 07 02:14:41 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Flow 'volume_create_manager' (ee9ef5ac-6960-4104-835b-32efec1a46a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f74c68-7e86-405b-a6e2-b79fbbe9738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f74c68-7e86-405b-a6e2-b79fbbe9738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-845902866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e25696-6faf-455e-a6b1-3a40553db0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47e202a71f944c4b92affbf9f4198d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:14:41Z,use_quota=True,user_id='168b811ca7114e468f77707f2937f5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afb8db1-55e6-4906-bac8-4ae49b4d701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afb8db1-55e6-4906-bac8-4ae49b4d701a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f742ce9-2886-448e-8c52-ebdf734c1716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f742ce9-2886-448e-8c52-ebdf734c1716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e25696-6faf-455e-a6b1-3a40553db0a2', 'volume_name': 'volume-97e25696-6faf-455e-a6b1-3a40553db0a2', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594d2f5e-f988-4ddc-b89a-d5bb7d83d50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594d2f5e-f988-4ddc-b89a-d5bb7d83d50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e653dfe-d3a1-49c9-8839-7440fe330eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:41 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Volume 97e25696-6faf-455e-a6b1-3a40553db0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e25696-6faf-455e-a6b1-3a40553db0a2', 'volume_size': 1} Sep 07 02:14:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:14:42 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Sep 07 02:14:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562 1073741824" returned: 0 in 1.275s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:14:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:14:42 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562 Sep 07 02:14:42 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:14:43 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562" returned: 0 in 0.577s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-845902866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e25696-6faf-455e-a6b1-3a40553db0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47e202a71f944c4b92affbf9f4198d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:14:41Z,use_quota=True,user_id='168b811ca7114e468f77707f2937f5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Creating volume 97e25696-6faf-455e-a6b1-3a40553db0a2 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:14:43 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d35b47-df34-4a71-8168-b1aaa94d3d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab16aa8-fd5f-4929-b502-4597fb232562', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7376e226-a3a9-454b-a7d3-063a6eed9693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:43 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2 1073741824 Sep 07 02:14:43 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:14:43 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Volume volume-dab16aa8-fd5f-4929-b502-4597fb232562 (dab16aa8-fd5f-4929-b502-4597fb232562): created successfully Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7376e226-a3a9-454b-a7d3-063a6eed9693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Flow 'volume_create_manager' (df9da7c8-668c-49c3-89b4-5d750917b53c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:14:43 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0d1b0cf5-63a9-48bc-b3cc-d40e5bc89fea tempest-TaggedAttachmentsTest-2068938375 None] Created volume successfully. Sep 07 02:14:44 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Sep 07 02:14:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2 1073741824" returned: 0 in 0.837s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:14:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:14:44 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2 Sep 07 02:14:44 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:14:44 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Sep 07 02:14:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2" returned: 0 in 0.513s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:14:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:14:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:14:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e653dfe-d3a1-49c9-8839-7440fe330eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e25696-6faf-455e-a6b1-3a40553db0a2', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335bf6ba-87ac-4d7b-9a3c-dd7cdaf0a783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:14:44 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Volume volume-97e25696-6faf-455e-a6b1-3a40553db0a2 (97e25696-6faf-455e-a6b1-3a40553db0a2): created successfully Sep 07 02:14:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335bf6ba-87ac-4d7b-9a3c-dd7cdaf0a783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:14:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Flow 'volume_create_manager' (ee9ef5ac-6960-4104-835b-32efec1a46a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:14:45 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3a20c56c-810e-4b35-af42-141a4c30d343 tempest-DeleteServersTestJSON-1141417934 None] Created volume successfully. Sep 07 02:14:51 devstack cinder-volume[87313]: WARNING py.warnings [req-467c556c-bed5-4fca-bf7d-25ab9c3f5605 req-401c0450-6174-4026-9ed7-e1d986582e56 tempest-DeleteServersTestJSON-1141417934 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 07 02:14:51 devstack cinder-volume[87313]: .first() Sep 07 02:14:51 devstack cinder-volume[87313]: Sep 07 02:14:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-467c556c-bed5-4fca-bf7d-25ab9c3f5605 req-401c0450-6174-4026-9ed7-e1d986582e56 tempest-DeleteServersTestJSON-1141417934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:14:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-467c556c-bed5-4fca-bf7d-25ab9c3f5605 req-401c0450-6174-4026-9ed7-e1d986582e56 tempest-DeleteServersTestJSON-1141417934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:14:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-467c556c-bed5-4fca-bf7d-25ab9c3f5605 req-401c0450-6174-4026-9ed7-e1d986582e56 tempest-DeleteServersTestJSON-1141417934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:14:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-467c556c-bed5-4fca-bf7d-25ab9c3f5605 req-401c0450-6174-4026-9ed7-e1d986582e56 tempest-DeleteServersTestJSON-1141417934 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-97e25696-6faf-455e-a6b1-3a40553db0a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15203589-a785-4a04-9f28-c9bff494a34f', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:14:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-467c556c-bed5-4fca-bf7d-25ab9c3f5605 req-401c0450-6174-4026-9ed7-e1d986582e56 tempest-DeleteServersTestJSON-1141417934 None] attachment_update completed successfully. Sep 07 02:14:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-8645ba87-f17f-42be-a735-5f280a6507c4 req-55c7a50d-defb-47e7-ae7a-ec4eb9dea8eb tempest-DeleteServersTestJSON-1141417934 None] Terminate volume connection completed successfully. Sep 07 02:14:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-8645ba87-f17f-42be-a735-5f280a6507c4 req-55c7a50d-defb-47e7-ae7a-ec4eb9dea8eb tempest-DeleteServersTestJSON-1141417934 None] Deleting attachment 15203589-a785-4a04-9f28-c9bff494a34f. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:15:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Acquiring lock "cinder-97e25696-6faf-455e-a6b1-3a40553db0a2-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Lock "cinder-97e25696-6faf-455e-a6b1-3a40553db0a2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Acquiring lock "cinder-quobyte-97e25696-6faf-455e-a6b1-3a40553db0a2" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Lock "cinder-quobyte-97e25696-6faf-455e-a6b1-3a40553db0a2" acquired by "delete_volume" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:00 devstack cinder-volume[87313]: INFO oslo.privsep.daemon [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmlf4e5pj/privsep.sock'] Sep 07 02:15:00 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmlf4e5pj/privsep.sock Sep 07 02:15:00 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:01 devstack cinder-volume[87313]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 07 02:15:01 devstack cinder-volume[87313]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 02:15:01 devstack cinder-volume[87313]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 07 02:15:01 devstack cinder-volume[87313]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 02:15:01 devstack cinder-volume[87313]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 07 02:15:01 devstack cinder-volume[87313]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 07 02:15:01 devstack cinder-volume[87313]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 02:15:01 devstack cinder-volume[87313]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 02:15:01 devstack cinder-volume[87313]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 07 02:15:01 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:01 devstack cinder-volume[87313]: INFO oslo.privsep.daemon [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Spawned new privsep daemon via rootwrap Sep 07 02:15:01 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Accepted privsep connection to /tmp/tmpmlf4e5pj/privsep.sock {{(pid=87313) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 07 02:15:01 devstack cinder-volume[87313]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 07 02:15:01 devstack cinder-volume[87313]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 07 02:15:01 devstack cinder-volume[87313]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 07 02:15:01 devstack cinder-volume[87313]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89020 Sep 07 02:15:01 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e0e7ad-a974-400a-aa11-6373af5de984]: (2,) {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:15:02 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b84a5d-134e-4c68-a7c8-675ec1ebe3e2]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:15:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:02 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2 Sep 07 02:15:02 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:02 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:02 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:15:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Flow 'volume_create_manager' (e62670e7-1462-4cfd-8526-b6c14a413e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a3968f-0d66-42de-926e-f13a54770375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2" returned: 0 in 1.002s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a3968f-0d66-42de-926e-f13a54770375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-367097155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f815e7b2-7bd0-405b-b92b-86e89a1398d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6506d4dad9c5424a8c53b80e7aa53b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:15:03Z,use_quota=True,user_id='b4924b56798f4f5fab1099f197e56448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a1d175-a18e-4ab1-add1-ebf850e66757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:03 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2 Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a1d175-a18e-4ab1-add1-ebf850e66757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:03 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49f45f8-a058-424b-8597-10a409e86b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49f45f8-a058-424b-8597-10a409e86b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f815e7b2-7bd0-405b-b92b-86e89a1398d8', 'volume_name': 'volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68026b85-1112-4e20-90cf-b286044c4666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68026b85-1112-4e20-90cf-b286044c4666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc70e12-4159-41cb-8f5c-8dce6a706a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:03 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Volume f815e7b2-7bd0-405b-b92b-86e89a1398d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8', 'volume_size': 1} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-367097155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f815e7b2-7bd0-405b-b92b-86e89a1398d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6506d4dad9c5424a8c53b80e7aa53b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:15:03Z,use_quota=True,user_id='b4924b56798f4f5fab1099f197e56448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Creating volume f815e7b2-7bd0-405b-b92b-86e89a1398d8 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:15:03 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:03 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8 1073741824 Sep 07 02:15:03 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:03 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-97e25696-6faf-455e-a6b1-3a40553db0a2" returned: 0 in 0.470s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Lock "cinder-quobyte-97e25696-6faf-455e-a6b1-3a40553db0a2" released by "delete_volume" :: held 3.000s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:15:03 devstack cinder-volume[87313]: WARNING cinder.quota [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:15:03 devstack cinder-volume[87313]: WARNING cinder.quota [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Created reservations ['886b882e-3df7-4937-b31d-777ab1a6da70', 'ff641d3f-134a-4474-9d8f-001ec1721a89', 'd8294e44-2dd9-41ca-a0ca-0a14d2bd19d8', '138e0a8a-35a5-4600-bebb-213970472f3e'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:03 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:15:03 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:03 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8 1073741824" returned: 0 in 0.754s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:04 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8 Sep 07 02:15:04 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:04 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8" returned: 0 in 0.380s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:15:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc70e12-4159-41cb-8f5c-8dce6a706a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cc572e-d099-4114-a468-e387da9ae694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:04 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Volume volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8 (f815e7b2-7bd0-405b-b92b-86e89a1398d8): created successfully Sep 07 02:15:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cc572e-d099-4114-a468-e387da9ae694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Flow 'volume_create_manager' (e62670e7-1462-4cfd-8526-b6c14a413e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:15:04 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.653s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:04 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:15:04 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5ca9c324-cb29-4931-803f-ca3cadd730fc tempest-ServersNegativeTestJSON-762998812 None] Created volume successfully. Sep 07 02:15:04 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Deleted volume successfully. Sep 07 02:15:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-62de334a-6be8-4043-817c-f0c7612f8396 tempest-DeleteServersTestJSON-1141417934 None] Lock "cinder-97e25696-6faf-455e-a6b1-3a40553db0a2-delete_volume" released by "delete_volume" :: held 4.112s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Flow 'volume_create_manager' (0c238fbc-ec20-4058-a1b2-7a6bf2cbf853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45917f90-2ec4-45ab-bab9-e2a731d87ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45917f90-2ec4-45ab-bab9-e2a731d87ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1381865138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc44021-8ef9-445c-a79c-b00643bca1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6506d4dad9c5424a8c53b80e7aa53b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:15:10Z,use_quota=True,user_id='b4924b56798f4f5fab1099f197e56448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c00e1f6-362e-4cc9-9a11-58a221ce3dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c00e1f6-362e-4cc9-9a11-58a221ce3dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ba62ec-6a5d-45e8-b2b1-8e9f783c200f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ba62ec-6a5d-45e8-b2b1-8e9f783c200f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc44021-8ef9-445c-a79c-b00643bca1ee', 'volume_name': 'volume-2bc44021-8ef9-445c-a79c-b00643bca1ee', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae297c3-46ae-4c74-9121-9a606da98afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae297c3-46ae-4c74-9121-9a606da98afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ebd4ef-8206-4a03-8067-210c2276e227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:09 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Volume 2bc44021-8ef9-445c-a79c-b00643bca1ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc44021-8ef9-445c-a79c-b00643bca1ee', 'volume_size': 1} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1381865138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc44021-8ef9-445c-a79c-b00643bca1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6506d4dad9c5424a8c53b80e7aa53b1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:15:10Z,use_quota=True,user_id='b4924b56798f4f5fab1099f197e56448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Creating volume 2bc44021-8ef9-445c-a79c-b00643bca1ee {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:15:09 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:15:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:09 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee 1073741824 Sep 07 02:15:09 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:10 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee 1073741824" returned: 0 in 0.604s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:10 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee Sep 07 02:15:10 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:11 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee" returned: 0 in 0.404s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:15:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ebd4ef-8206-4a03-8067-210c2276e227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc44021-8ef9-445c-a79c-b00643bca1ee', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5bf566-53d7-404e-b8a0-190096a81319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:11 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Volume volume-2bc44021-8ef9-445c-a79c-b00643bca1ee (2bc44021-8ef9-445c-a79c-b00643bca1ee): created successfully Sep 07 02:15:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5bf566-53d7-404e-b8a0-190096a81319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Flow 'volume_create_manager' (0c238fbc-ec20-4058-a1b2-7a6bf2cbf853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:15:11 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-915cab3d-cfac-4c76-ae5b-e528674161f2 tempest-ServersNegativeTestJSON-762998812 None] Created volume successfully. Sep 07 02:15:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Acquiring lock "cinder-2bc44021-8ef9-445c-a79c-b00643bca1ee-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Lock "cinder-2bc44021-8ef9-445c-a79c-b00643bca1ee-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Acquiring lock "cinder-quobyte-2bc44021-8ef9-445c-a79c-b00643bca1ee" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Lock "cinder-quobyte-2bc44021-8ef9-445c-a79c-b00643bca1ee" acquired by "delete_volume" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:14 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6c0993-d0f5-44fc-9782-b1da9071319a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:15:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:14 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee Sep 07 02:15:14 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:15 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee" returned: 0 in 0.716s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:15 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee Sep 07 02:15:15 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:15 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2bc44021-8ef9-445c-a79c-b00643bca1ee" returned: 0 in 0.391s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Lock "cinder-quobyte-2bc44021-8ef9-445c-a79c-b00643bca1ee" released by "delete_volume" :: held 1.203s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Created reservations ['1373b3c3-4f85-4969-915a-d4f90e4c5f2f', '38c06ff1-277e-40c8-9017-cfb9d641ce79', '6ec87244-8f98-4122-a6ae-c48acb5ff2d1', '9e4cae54-7484-4265-a9bd-278589eb1900'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:15 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:15:15 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:15 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.298s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:15:15 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Deleted volume successfully. Sep 07 02:15:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-226e2256-6037-405a-b03c-0b237cbdaa34 tempest-ServersNegativeTestJSON-762998812 None] Lock "cinder-2bc44021-8ef9-445c-a79c-b00643bca1ee-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:15:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Acquiring lock "cinder-f815e7b2-7bd0-405b-b92b-86e89a1398d8-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Lock "cinder-f815e7b2-7bd0-405b-b92b-86e89a1398d8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Acquiring lock "cinder-quobyte-f815e7b2-7bd0-405b-b92b-86e89a1398d8" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Lock "cinder-quobyte-f815e7b2-7bd0-405b-b92b-86e89a1398d8" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:16 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[48613881-c9c5-4178-9008-d94fc26bd3cc]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:15:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:16 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8 Sep 07 02:15:16 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:17 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8" returned: 0 in 0.515s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:17 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8 Sep 07 02:15:17 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:17 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f815e7b2-7bd0-405b-b92b-86e89a1398d8" returned: 0 in 0.345s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Lock "cinder-quobyte-f815e7b2-7bd0-405b-b92b-86e89a1398d8" released by "delete_volume" :: held 0.909s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:15:17 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Created reservations ['63665190-6ad3-45d2-8561-375b6a513c05', '60b2bbfc-a6ff-4b15-b8bd-208b44071719', 'de5ac328-42ac-4e2e-901b-6e60ef1856f8', 'c6fee9b0-a26b-46f1-b4d1-ee13d92fb84c'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:15:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:17 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:15:17 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:18 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.431s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:18 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:15:18 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Deleted volume successfully. Sep 07 02:15:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f5ec8df-466e-49ab-aa25-3debd953568b tempest-ServersNegativeTestJSON-762998812 None] Lock "cinder-f815e7b2-7bd0-405b-b92b-86e89a1398d8-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:26 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:15:26 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:26 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.290s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 8 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:15:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:15:27 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=33,cinder:INSERT=9,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:15:28 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=40,cinder:SELECT=28,cinder:DELETE=6,cinder:INSERT=7 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Flow 'volume_create_manager' (d3517772-3726-4b75-9d6e-b1b33bc870e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8b48c5-d025-43df-b8de-b84891029e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8b48c5-d025-43df-b8de-b84891029e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1142569193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14a4973-4334-43cc-b4fc-534976e7c88d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3195080b9df4082a68cff097547be95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:15:39Z,use_quota=True,user_id='058876f9a20f4ea78669ea81667a1b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464fffbc-0ec6-42b8-ae7a-1a2e4f36793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464fffbc-0ec6-42b8-ae7a-1a2e4f36793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f33c7a8-1ab1-4a51-837c-54439a560868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f33c7a8-1ab1-4a51-837c-54439a560868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14a4973-4334-43cc-b4fc-534976e7c88d', 'volume_name': 'volume-f14a4973-4334-43cc-b4fc-534976e7c88d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11c9e1b-0ef2-450a-9b57-20446c83a040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11c9e1b-0ef2-450a-9b57-20446c83a040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e498a33b-9c33-4412-97fd-b9c3634469e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:38 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Volume f14a4973-4334-43cc-b4fc-534976e7c88d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14a4973-4334-43cc-b4fc-534976e7c88d', 'volume_size': 1} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1142569193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14a4973-4334-43cc-b4fc-534976e7c88d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3195080b9df4082a68cff097547be95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:15:39Z,use_quota=True,user_id='058876f9a20f4ea78669ea81667a1b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Creating volume f14a4973-4334-43cc-b4fc-534976e7c88d {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:15:38 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:15:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:39 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d 1073741824 Sep 07 02:15:39 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:39 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d 1073741824" returned: 0 in 0.836s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:39 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d Sep 07 02:15:39 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:40 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d" returned: 0 in 0.365s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:15:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e498a33b-9c33-4412-97fd-b9c3634469e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14a4973-4334-43cc-b4fc-534976e7c88d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5495dfe0-7ce7-44fd-8562-ec0b806a3fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:40 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Volume volume-f14a4973-4334-43cc-b4fc-534976e7c88d (f14a4973-4334-43cc-b4fc-534976e7c88d): created successfully Sep 07 02:15:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5495dfe0-7ce7-44fd-8562-ec0b806a3fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Flow 'volume_create_manager' (d3517772-3726-4b75-9d6e-b1b33bc870e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:15:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-15500538-398c-4459-8454-6f54652bee33 tempest-VolumesTestJSON-2118438753 None] Created volume successfully. Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-b58dcf26-1ea1-4222-a34f-70c3d1770cfd req-acbef8fa-8659-4daa-af88-435225ffedee tempest-TaggedAttachmentsTest-2068938375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-b58dcf26-1ea1-4222-a34f-70c3d1770cfd req-acbef8fa-8659-4daa-af88-435225ffedee tempest-TaggedAttachmentsTest-2068938375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-b58dcf26-1ea1-4222-a34f-70c3d1770cfd req-acbef8fa-8659-4daa-af88-435225ffedee tempest-TaggedAttachmentsTest-2068938375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-b58dcf26-1ea1-4222-a34f-70c3d1770cfd req-acbef8fa-8659-4daa-af88-435225ffedee tempest-TaggedAttachmentsTest-2068938375 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-dab16aa8-fd5f-4929-b502-4597fb232562', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dadd6d78-0cf9-4e80-a536-c335925f069d', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Flow 'volume_create_manager' (af7d3c99-eb39-41f0-9368-754d36c09af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528b64b9-0dd2-4325-add0-a2ed5420c575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528b64b9-0dd2-4325-add0-a2ed5420c575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-675354845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3234df-3718-4476-b1b4-311c3dfbd739,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3195080b9df4082a68cff097547be95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:15:42Z,use_quota=True,user_id='058876f9a20f4ea78669ea81667a1b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213b2f1a-5a50-4acc-8ff8-ac79d007a582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213b2f1a-5a50-4acc-8ff8-ac79d007a582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04342424-c51a-472f-8e98-2905e5e047b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04342424-c51a-472f-8e98-2905e5e047b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce3234df-3718-4476-b1b4-311c3dfbd739', 'volume_name': 'volume-ce3234df-3718-4476-b1b4-311c3dfbd739', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472262e4-6cb7-45f3-80f2-18592427e8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472262e4-6cb7-45f3-80f2-18592427e8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59e1321-a8df-416d-82ab-29e27c20b049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:41 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Volume ce3234df-3718-4476-b1b4-311c3dfbd739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce3234df-3718-4476-b1b4-311c3dfbd739', 'volume_size': 1} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-675354845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3234df-3718-4476-b1b4-311c3dfbd739,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3195080b9df4082a68cff097547be95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:15:42Z,use_quota=True,user_id='058876f9a20f4ea78669ea81667a1b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Creating volume ce3234df-3718-4476-b1b4-311c3dfbd739 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:15:41 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:15:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:41 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739 1073741824 Sep 07 02:15:42 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:42 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-b58dcf26-1ea1-4222-a34f-70c3d1770cfd req-acbef8fa-8659-4daa-af88-435225ffedee tempest-TaggedAttachmentsTest-2068938375 None] attachment_update completed successfully. Sep 07 02:15:42 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739 1073741824" returned: 0 in 0.597s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:42 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739 Sep 07 02:15:42 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:42 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739" returned: 0 in 0.384s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:15:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59e1321-a8df-416d-82ab-29e27c20b049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce3234df-3718-4476-b1b4-311c3dfbd739', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f381c6-f400-4ba4-900f-1276dde3f5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:43 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Volume volume-ce3234df-3718-4476-b1b4-311c3dfbd739 (ce3234df-3718-4476-b1b4-311c3dfbd739): created successfully Sep 07 02:15:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f381c6-f400-4ba4-900f-1276dde3f5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Flow 'volume_create_manager' (af7d3c99-eb39-41f0-9368-754d36c09af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:15:43 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-30e5e444-e340-4234-9cba-1e699638a027 tempest-VolumesTestJSON-2118438753 None] Created volume successfully. Sep 07 02:15:44 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Flow 'volume_create_manager' (2631901a-f57c-4e29-91a2-08a6a32866bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d6039e-1af4-4ca9-aa69-741f846c57fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d6039e-1af4-4ca9-aa69-741f846c57fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2141649367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980e7538-a151-4d66-b896-1ebc96558862,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3195080b9df4082a68cff097547be95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:15:45Z,use_quota=True,user_id='058876f9a20f4ea78669ea81667a1b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29221033-c650-4588-9e2d-ee208f5b2447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29221033-c650-4588-9e2d-ee208f5b2447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb34d68c-9abc-44fb-9bb4-f6755787f3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb34d68c-9abc-44fb-9bb4-f6755787f3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980e7538-a151-4d66-b896-1ebc96558862', 'volume_name': 'volume-980e7538-a151-4d66-b896-1ebc96558862', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19a9ab2-c19a-42f9-a1df-1e38c2b8dee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19a9ab2-c19a-42f9-a1df-1e38c2b8dee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad064892-ca88-414f-b433-60365cc35e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:45 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Volume 980e7538-a151-4d66-b896-1ebc96558862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980e7538-a151-4d66-b896-1ebc96558862', 'volume_size': 1} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2141649367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980e7538-a151-4d66-b896-1ebc96558862,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3195080b9df4082a68cff097547be95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:15:45Z,use_quota=True,user_id='058876f9a20f4ea78669ea81667a1b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Creating volume 980e7538-a151-4d66-b896-1ebc96558862 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:15:45 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:15:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:45 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862 1073741824 Sep 07 02:15:45 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:46 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862 1073741824" returned: 0 in 1.109s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:46 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862 Sep 07 02:15:46 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:46 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862" returned: 0 in 0.481s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:15:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad064892-ca88-414f-b433-60365cc35e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980e7538-a151-4d66-b896-1ebc96558862', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f864baa0-a358-45f0-9880-82f4dfc64f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:15:46 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Volume volume-980e7538-a151-4d66-b896-1ebc96558862 (980e7538-a151-4d66-b896-1ebc96558862): created successfully Sep 07 02:15:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f864baa0-a358-45f0-9880-82f4dfc64f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:15:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Flow 'volume_create_manager' (2631901a-f57c-4e29-91a2-08a6a32866bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:15:46 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9a466049-85fa-461d-b848-5b7372cdc93f tempest-VolumesTestJSON-2118438753 None] Created volume successfully. Sep 07 02:15:48 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-3c785fbb-cefa-4599-93eb-53fd739e5962 req-09146e7b-c12a-480b-8759-25121f41ea4a tempest-TaggedAttachmentsTest-2068938375 None] Terminate volume connection completed successfully. Sep 07 02:15:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-3c785fbb-cefa-4599-93eb-53fd739e5962 req-09146e7b-c12a-480b-8759-25121f41ea4a tempest-TaggedAttachmentsTest-2068938375 None] Deleting attachment dadd6d78-0cf9-4e80-a536-c335925f069d. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:15:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Acquiring lock "cinder-980e7538-a151-4d66-b896-1ebc96558862-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Lock "cinder-980e7538-a151-4d66-b896-1ebc96558862-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Acquiring lock "cinder-quobyte-980e7538-a151-4d66-b896-1ebc96558862" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Lock "cinder-quobyte-980e7538-a151-4d66-b896-1ebc96558862" acquired by "delete_volume" :: waited 0.033s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa63d6e0-6ea9-4486-b02e-7bd4d550be21]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:15:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:49 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862 Sep 07 02:15:49 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:50 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862" returned: 0 in 0.872s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:50 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862 Sep 07 02:15:50 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:50 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-980e7538-a151-4d66-b896-1ebc96558862" returned: 0 in 0.381s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Lock "cinder-quobyte-980e7538-a151-4d66-b896-1ebc96558862" released by "delete_volume" :: held 1.331s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:15:50 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Created reservations ['c028e243-e448-482d-99b5-a4ad28360fcd', '749f394a-6a4e-4cc9-ac99-e41a1ae40497', '668adbb7-759c-4993-a087-8630ba913b53', '0381cab2-2140-4833-b6c6-6e7dc45c1bf3'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:15:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:50 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:15:50 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:51 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.481s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:51 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:15:51 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Deleted volume successfully. Sep 07 02:15:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6cec10b8-7dc8-4538-bfb1-e9d836afbb9e tempest-VolumesTestJSON-2118438753 None] Lock "cinder-980e7538-a151-4d66-b896-1ebc96558862-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:15:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Acquiring lock "cinder-ce3234df-3718-4476-b1b4-311c3dfbd739-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Lock "cinder-ce3234df-3718-4476-b1b4-311c3dfbd739-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Acquiring lock "cinder-quobyte-ce3234df-3718-4476-b1b4-311c3dfbd739" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Lock "cinder-quobyte-ce3234df-3718-4476-b1b4-311c3dfbd739" acquired by "delete_volume" :: waited 0.043s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:52 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1fd92b-dde0-4243-8f08-5f19fbb68d80]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:15:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:52 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739 Sep 07 02:15:52 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:53 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739" returned: 0 in 0.853s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:53 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739 Sep 07 02:15:53 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:53 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ce3234df-3718-4476-b1b4-311c3dfbd739" returned: 0 in 0.545s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Lock "cinder-quobyte-ce3234df-3718-4476-b1b4-311c3dfbd739" released by "delete_volume" :: held 1.513s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:15:53 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Created reservations ['64c66135-f4d9-4b50-beb8-3ebd0426c8d0', '828c90f0-21c4-4df6-8724-048da71f5688', 'a22f2de7-9644-46a5-a8ba-dd21805ba037', '65c95565-afe7-4758-9a31-56f2ee053b29'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:54 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:15:54 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Acquiring lock "cinder-f14a4973-4334-43cc-b4fc-534976e7c88d-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Lock "cinder-f14a4973-4334-43cc-b4fc-534976e7c88d-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Acquiring lock "cinder-quobyte-f14a4973-4334-43cc-b4fc-534976e7c88d" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Lock "cinder-quobyte-f14a4973-4334-43cc-b4fc-534976e7c88d" acquired by "delete_volume" :: waited 0.057s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:15:54 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.848s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[13401f11-0bd9-4905-87cf-41545bf2d6a8]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:15:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Deleted volume successfully. Sep 07 02:15:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1584a30e-ee23-4b55-82d9-ed2de2b0c74e tempest-VolumesTestJSON-2118438753 None] Lock "cinder-ce3234df-3718-4476-b1b4-311c3dfbd739-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:15:55 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d Sep 07 02:15:55 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:56 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d" returned: 0 in 1.098s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:56 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d Sep 07 02:15:56 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f14a4973-4334-43cc-b4fc-534976e7c88d" returned: 0 in 0.616s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Lock "cinder-quobyte-f14a4973-4334-43cc-b4fc-534976e7c88d" released by "delete_volume" :: held 1.824s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:15:56 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:56 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Created reservations ['710c9140-b1dd-495c-9b6f-95fad9f75e69', '29b436e4-645f-4aed-9e18-a1f991e4b67b', 'f0f57299-c6e0-4913-a244-3d95e2a2c05a', '240e4f18-e282-4e7a-89b2-7843f989af24'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:15:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:15:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:15:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:15:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:15:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:15:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:15:56 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:15:56 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:15:57 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Sep 07 02:15:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.477s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:15:57 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:15:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Deleted volume successfully. Sep 07 02:15:57 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2504ad38-f224-41c9-99d0-7d0fb9122c95 tempest-VolumesTestJSON-2118438753 None] Lock "cinder-f14a4973-4334-43cc-b4fc-534976e7c88d-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:16:06 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=35,cinder:SELECT=27,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:16:07 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=31,cinder:UPDATE=35,cinder:DELETE=4,cinder:INSERT=8 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:16:07 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8f127003-a8c1-4fa5-a5e9-4bbe954b0741 tempest-GroupsV320Test-357684396 None] Group tempest-GroupsV320Test-Group-827849932: creating Sep 07 02:16:07 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8f127003-a8c1-4fa5-a5e9-4bbe954b0741 tempest-GroupsV320Test-357684396 None] Group tempest-GroupsV320Test-Group-827849932: created successfully Sep 07 02:16:07 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8f127003-a8c1-4fa5-a5e9-4bbe954b0741 tempest-GroupsV320Test-357684396 None] Create group completed successfully. Sep 07 02:16:09 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-40bffbe8-f3a4-4d5e-b295-c8328242795d tempest-GroupsV320Test-357684396 None] Created reservations ['7ee41eb4-b274-4dda-b021-bf817f1a02b4'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:16:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-40bffbe8-f3a4-4d5e-b295-c8328242795d tempest-GroupsV320Test-357684396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-40bffbe8-f3a4-4d5e-b295-c8328242795d tempest-GroupsV320Test-357684396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-40bffbe8-f3a4-4d5e-b295-c8328242795d tempest-GroupsV320Test-357684396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-40bffbe8-f3a4-4d5e-b295-c8328242795d tempest-GroupsV320Test-357684396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-40bffbe8-f3a4-4d5e-b295-c8328242795d tempest-GroupsV320Test-357684396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-40bffbe8-f3a4-4d5e-b295-c8328242795d tempest-GroupsV320Test-357684396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:10 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:16:10 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Flow 'volume_create_manager' (726fa986-8813-4acf-8e32-cf5f4127e068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5c250f-f963-496a-ac1f-5f4b290907a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5c250f-f963-496a-ac1f-5f4b290907a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1631332721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fc920f-e76d-4382-afa0-37845526c453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1675c916b8438084bf15fcdc506a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:10Z,use_quota=True,user_id='e2611e2d641f472b9889d550d374b677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6127648f-1ba9-42e5-be5c-72a70408ab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6127648f-1ba9-42e5-be5c-72a70408ab5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f1ea55-aef9-4a11-8cc0-7b041b957cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f1ea55-aef9-4a11-8cc0-7b041b957cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6fc920f-e76d-4382-afa0-37845526c453', 'volume_name': 'volume-c6fc920f-e76d-4382-afa0-37845526c453', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebc1dd7-5001-4ebf-b9a2-cb33a5cfdc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebc1dd7-5001-4ebf-b9a2-cb33a5cfdc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df24aa8-c053-48c9-8319-67ebeec1bfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:10 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Volume c6fc920f-e76d-4382-afa0-37845526c453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6fc920f-e76d-4382-afa0-37845526c453', 'volume_size': 1} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1631332721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fc920f-e76d-4382-afa0-37845526c453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1675c916b8438084bf15fcdc506a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:10Z,use_quota=True,user_id='e2611e2d641f472b9889d550d374b677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Creating volume c6fc920f-e76d-4382-afa0-37845526c453 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:16:10 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:10 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453 1073741824 Sep 07 02:16:10 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:10 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-40bffbe8-f3a4-4d5e-b295-c8328242795d tempest-GroupsV320Test-357684396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.606s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:10 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-40bffbe8-f3a4-4d5e-b295-c8328242795d tempest-GroupsV320Test-357684396 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:16:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-40bffbe8-f3a4-4d5e-b295-c8328242795d tempest-GroupsV320Test-357684396 None] Delete group completed successfully. Sep 07 02:16:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Acquiring lock "cinder-dab16aa8-fd5f-4929-b502-4597fb232562-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Lock "cinder-dab16aa8-fd5f-4929-b502-4597fb232562-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Acquiring lock "cinder-quobyte-dab16aa8-fd5f-4929-b502-4597fb232562" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Lock "cinder-quobyte-dab16aa8-fd5f-4929-b502-4597fb232562" acquired by "delete_volume" :: waited 0.029s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[87154aa5-833b-4954-bf28-4f769bb9da23]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:16:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:11 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453 1073741824" returned: 0 in 1.099s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:11 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562 Sep 07 02:16:11 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:11 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453 Sep 07 02:16:11 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:12 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453" returned: 0 in 0.840s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:16:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:12 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562" returned: 0 in 1.123s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:12 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562 Sep 07 02:16:12 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:12 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df24aa8-c053-48c9-8319-67ebeec1bfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6fc920f-e76d-4382-afa0-37845526c453', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:12 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e196ea-1ef5-4150-a583-28d1c1883bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:12 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Volume volume-c6fc920f-e76d-4382-afa0-37845526c453 (c6fc920f-e76d-4382-afa0-37845526c453): created successfully Sep 07 02:16:12 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e196ea-1ef5-4150-a583-28d1c1883bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:12 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Flow 'volume_create_manager' (726fa986-8813-4acf-8e32-cf5f4127e068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:12 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-95d6659b-6cca-4108-b31a-335f8b548c18 tempest-ServerRescueNegativeTestJSON-1073607064 None] Created volume successfully. Sep 07 02:16:12 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dab16aa8-fd5f-4929-b502-4597fb232562" returned: 0 in 0.486s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Lock "cinder-quobyte-dab16aa8-fd5f-4929-b502-4597fb232562" released by "delete_volume" :: held 1.737s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:16:13 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Created reservations ['8f5b9358-941e-4374-bce4-1ac17225e40c', '6b0171a9-325d-473a-ab09-d78e3a17b7c5', 'b41832c3-da35-4adb-8e4b-f788943ce5a8', 'f29a6ebd-151f-426b-99bf-3facc0c16e72'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:16:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:13 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:16:13 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:13 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.529s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:13 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:16:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Deleted volume successfully. Sep 07 02:16:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1b2b7620-316b-41c0-8a41-a2cb1532a7a9 tempest-TaggedAttachmentsTest-2068938375 None] Lock "cinder-dab16aa8-fd5f-4929-b502-4597fb232562-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:16:23 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=12,cinder:UPDATE=16,cinder:INSERT=3 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:16:23 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=15,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:26 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:16:26 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Flow 'volume_create_manager' (822150f7-d258-4d2d-979d-c554482ef3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee22da5-b9d2-49b5-b403-0fb0582fb602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:26 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.573s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 8 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee22da5-b9d2-49b5-b403-0fb0582fb602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-389858170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f36f72b-545e-4f99-9a7c-663d3e03fcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fe8b3d10ab4b6a97b12471c268b01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:26Z,use_quota=True,user_id='e90fdc973619493f8a024050858d0fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13464cc9-9e14-41af-b773-c7fd35d8c592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13464cc9-9e14-41af-b773-c7fd35d8c592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c8cc81-ac5f-4d8e-a572-fb4cdae97854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c8cc81-ac5f-4d8e-a572-fb4cdae97854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f36f72b-545e-4f99-9a7c-663d3e03fcac', 'volume_name': 'volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757c9182-6bda-4040-84b5-7dc41f20a596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757c9182-6bda-4040-84b5-7dc41f20a596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ec8c49-7904-4360-b9af-c101a055ff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:26 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Volume 8f36f72b-545e-4f99-9a7c-663d3e03fcac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac', 'volume_size': 1} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-389858170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f36f72b-545e-4f99-9a7c-663d3e03fcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fe8b3d10ab4b6a97b12471c268b01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:26Z,use_quota=True,user_id='e90fdc973619493f8a024050858d0fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Creating volume 8f36f72b-545e-4f99-9a7c-663d3e03fcac {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:16:26 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:16:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:26 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac 1073741824 Sep 07 02:16:26 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:28 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac 1073741824" returned: 0 in 1.177s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:28 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac Sep 07 02:16:28 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:28 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac" returned: 0 in 0.801s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:16:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ec8c49-7904-4360-b9af-c101a055ff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a285d744-c075-423e-9529-1207c7a8d509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:29 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Volume volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac (8f36f72b-545e-4f99-9a7c-663d3e03fcac): created successfully Sep 07 02:16:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a285d744-c075-423e-9529-1207c7a8d509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Flow 'volume_create_manager' (822150f7-d258-4d2d-979d-c554482ef3af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:29 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d2b34852-8610-46ba-9708-f74f2c6035e5 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Created volume successfully. Sep 07 02:16:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Acquiring lock "cinder-8f36f72b-545e-4f99-9a7c-663d3e03fcac-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "cinder-8f36f72b-545e-4f99-9a7c-663d3e03fcac-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Acquiring lock "cinder-quobyte-8f36f72b-545e-4f99-9a7c-663d3e03fcac" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "cinder-quobyte-8f36f72b-545e-4f99-9a7c-663d3e03fcac" acquired by "delete_volume" :: waited 0.058s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:30 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab9a1eb-0fc6-47be-a808-ca111c6e2725]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:16:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:30 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac Sep 07 02:16:30 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:31 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac" returned: 0 in 0.768s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:31 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac Sep 07 02:16:31 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:31 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8f36f72b-545e-4f99-9a7c-663d3e03fcac" returned: 0 in 0.421s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "cinder-quobyte-8f36f72b-545e-4f99-9a7c-663d3e03fcac" released by "delete_volume" :: held 1.352s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:16:32 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Created reservations ['45df330a-3584-4d07-a962-998b60a9f859', '687ba7b4-f6ac-46fc-95f9-9c36da1df8a8', '5d73576a-c61e-4e91-b69f-c9eae242ad95', '1bc36e0a-1cab-4053-a1ac-522202b9d45c'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:16:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:32 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:16:32 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:32 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.472s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:32 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:16:32 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Deleted volume successfully. Sep 07 02:16:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12618b1f-b2a8-4370-874d-83c440f3ea35 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "cinder-8f36f72b-545e-4f99-9a7c-663d3e03fcac-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Flow 'volume_create_manager' (4f4325b8-ecc4-41e6-b787-f89150ac0787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e67b784-858b-4a99-bcfd-5f6bd60dbf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e67b784-858b-4a99-bcfd-5f6bd60dbf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-208687416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0b42fd-e4dd-48f7-9247-401676fbbdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fe535b9b5a4ab1aa3b85832f635182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:33Z,use_quota=True,user_id='93fec6d6003843d8b45d61c8459313ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7627bb-4d61-4baa-9240-f337a03d1290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7627bb-4d61-4baa-9240-f337a03d1290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8800acb4-e27f-4322-b949-d06ee2e06e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8800acb4-e27f-4322-b949-d06ee2e06e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b0b42fd-e4dd-48f7-9247-401676fbbdad', 'volume_name': 'volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d064a8-77c6-4b71-8199-77f04812c9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d064a8-77c6-4b71-8199-77f04812c9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fbf9a2-6fa3-4d37-a26a-9f9201c1ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:33 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Volume 5b0b42fd-e4dd-48f7-9247-401676fbbdad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad', 'volume_size': 1} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-208687416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0b42fd-e4dd-48f7-9247-401676fbbdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fe535b9b5a4ab1aa3b85832f635182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:33Z,use_quota=True,user_id='93fec6d6003843d8b45d61c8459313ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Creating volume 5b0b42fd-e4dd-48f7-9247-401676fbbdad {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:16:33 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:16:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:33 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad 1073741824 Sep 07 02:16:33 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Flow 'volume_create_manager' (1f8bfb68-5487-46d1-8f5b-b07e6e858fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb59ef9-1cf2-4da6-9685-5b49dde27cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb59ef9-1cf2-4da6-9685-5b49dde27cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1641900653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f47e84-b824-410c-a2bd-dc16fc4546b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fe8b3d10ab4b6a97b12471c268b01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:34Z,use_quota=True,user_id='e90fdc973619493f8a024050858d0fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb2d7b5-ec8c-48fc-b355-4fd8e2815669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb2d7b5-ec8c-48fc-b355-4fd8e2815669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332292ae-37ec-48fe-bd20-ba8fb0a22f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332292ae-37ec-48fe-bd20-ba8fb0a22f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f47e84-b824-410c-a2bd-dc16fc4546b0', 'volume_name': 'volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c52e6c-3b5a-4aee-aaa6-b8d462c9f640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:34 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c52e6c-3b5a-4aee-aaa6-b8d462c9f640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e423be-e8b2-4c79-b9b1-798945274cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:34 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Volume e5f47e84-b824-410c-a2bd-dc16fc4546b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0', 'volume_size': 1} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad 1073741824" returned: 0 in 0.962s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:34 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad Sep 07 02:16:34 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Acquiring lock "cinder-c6fc920f-e76d-4382-afa0-37845526c453-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Lock "cinder-c6fc920f-e76d-4382-afa0-37845526c453-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:34 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad" returned: 0 in 0.449s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1641900653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f47e84-b824-410c-a2bd-dc16fc4546b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68fe8b3d10ab4b6a97b12471c268b01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:34Z,use_quota=True,user_id='e90fdc973619493f8a024050858d0fab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Creating volume e5f47e84-b824-410c-a2bd-dc16fc4546b0 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:16:34 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Acquiring lock "cinder-quobyte-c6fc920f-e76d-4382-afa0-37845526c453" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:34 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0 1073741824 Sep 07 02:16:34 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fbf9a2-6fa3-4d37-a26a-9f9201c1ae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64e3910-cb74-45d3-91d9-a4db230a56e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Lock "cinder-quobyte-c6fc920f-e76d-4382-afa0-37845526c453" acquired by "delete_volume" :: waited 0.058s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cb1b1b-df1d-49a1-b08b-4ec7e6f9b50c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:34 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Volume volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad (5b0b42fd-e4dd-48f7-9247-401676fbbdad): created successfully Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64e3910-cb74-45d3-91d9-a4db230a56e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Flow 'volume_create_manager' (4f4325b8-ecc4-41e6-b787-f89150ac0787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-24b10dc1-2a3d-445d-9ed7-73a87cb41c2f tempest-VolumesAdminNegativeTest-657443535 None] Created volume successfully. Sep 07 02:16:35 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453 Sep 07 02:16:35 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:35 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0 1073741824" returned: 0 in 0.769s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:35 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0 Sep 07 02:16:35 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:35 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453" returned: 0 in 0.881s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:35 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453 Sep 07 02:16:35 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:36 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0" returned: 0 in 0.511s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e423be-e8b2-4c79-b9b1-798945274cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a64521-2a60-4608-bf3a-1a3edfb9c8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:36 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Volume volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0 (e5f47e84-b824-410c-a2bd-dc16fc4546b0): created successfully Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a64521-2a60-4608-bf3a-1a3edfb9c8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Flow 'volume_create_manager' (1f8bfb68-5487-46d1-8f5b-b07e6e858fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-883e7dba-c14e-4b9a-a396-4a20f2cc11b6 tempest-VolumeQuotasAdminTestJSON-1377745627 None] Created volume successfully. Sep 07 02:16:36 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Acquiring lock "cinder-5b0b42fd-e4dd-48f7-9247-401676fbbdad-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6fc920f-e76d-4382-afa0-37845526c453" returned: 0 in 0.611s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Lock "cinder-quobyte-c6fc920f-e76d-4382-afa0-37845526c453" released by "delete_volume" :: held 1.594s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Lock "cinder-5b0b42fd-e4dd-48f7-9247-401676fbbdad-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Acquiring lock "cinder-quobyte-5b0b42fd-e4dd-48f7-9247-401676fbbdad" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Created reservations ['369993ef-c0e1-46e5-bb90-50f19f397745', 'e51e9668-dc27-4c63-a6eb-11fc6198eb98', '0ed1acfd-a409-4bc1-aafc-810135160f7a', 'b9a65730-19d9-471e-9d73-fe82260c5e2b'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Lock "cinder-quobyte-5b0b42fd-e4dd-48f7-9247-401676fbbdad" acquired by "delete_volume" :: waited 0.051s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa61c56-760c-4251-9dcd-e8475cdd71c7]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:36 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:16:36 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:36 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad Sep 07 02:16:36 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:37 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad" returned: 0 in 0.839s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:37 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:37 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad Sep 07 02:16:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.851s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:37 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:37 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:16:37 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Deleted volume successfully. Sep 07 02:16:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9128b8bf-bbef-41a5-89fa-23f96b8fc1e1 tempest-ServerRescueNegativeTestJSON-1073607064 None] Lock "cinder-c6fc920f-e76d-4382-afa0-37845526c453-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:16:38 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5b0b42fd-e4dd-48f7-9247-401676fbbdad" returned: 0 in 0.836s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Lock "cinder-quobyte-5b0b42fd-e4dd-48f7-9247-401676fbbdad" released by "delete_volume" :: held 1.779s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:16:38 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Created reservations ['1dca4679-4a0f-4b86-8fa1-533353a451dd', 'c9817015-4391-427f-9d53-7c70b64db5a1', '509d7aff-a7d8-49ae-add4-b42136439b53', '9e43896d-91f7-4073-a27b-28c8f17df6c5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:16:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-903bb6d5-0c0f-4309-a6f8-77a2b0ab6027 tempest-VolumeQuotasAdminTestJSON-419287564 None] Transfer volume completed successfully. Sep 07 02:16:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:38 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:16:38 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:39 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.807s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:39 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:16:39 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Deleted volume successfully. Sep 07 02:16:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9615f265-d7fd-4292-93a6-679a784f24d1 tempest-VolumesAdminNegativeTest-657443535 None] Lock "cinder-5b0b42fd-e4dd-48f7-9247-401676fbbdad-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:16:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Acquiring lock "cinder-e5f47e84-b824-410c-a2bd-dc16fc4546b0-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Lock "cinder-e5f47e84-b824-410c-a2bd-dc16fc4546b0-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Acquiring lock "cinder-quobyte-e5f47e84-b824-410c-a2bd-dc16fc4546b0" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Lock "cinder-quobyte-e5f47e84-b824-410c-a2bd-dc16fc4546b0" acquired by "delete_volume" :: waited 0.044s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:40 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded14bb8-736d-4234-bd59-1b3b6094581e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:16:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:40 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0 Sep 07 02:16:40 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:41 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0" returned: 0 in 0.901s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:41 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0 Sep 07 02:16:41 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:42 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e5f47e84-b824-410c-a2bd-dc16fc4546b0" returned: 0 in 0.620s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Lock "cinder-quobyte-e5f47e84-b824-410c-a2bd-dc16fc4546b0" released by "delete_volume" :: held 1.589s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:16:42 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Created reservations ['1acfaa8a-6964-447a-8dfc-31dd26a6334d', '5dd0cb17-0982-4f58-ac5e-1e0df7d93f8f', '8d0ccc59-0e7a-4711-b4fc-2993dc66f0a7', '83f6d7da-05c5-4e3c-b3c4-c372cac8063c'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:16:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:42 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:16:42 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:43 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.677s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:43 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:16:43 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Deleted volume successfully. Sep 07 02:16:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f866121-cf21-4125-9409-419b43ff2472 tempest-VolumeQuotasAdminTestJSON-1045724889 None] Lock "cinder-e5f47e84-b824-410c-a2bd-dc16fc4546b0-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:16:52 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=30,cinder:INSERT=10,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:16:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e5e45bcf-fe51-4382-acc7-7a9ad13778d4 tempest-GroupsTest-1080864915 None] Group tempest-Group1-1870946350: creating Sep 07 02:16:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e5e45bcf-fe51-4382-acc7-7a9ad13778d4 tempest-GroupsTest-1080864915 None] Group tempest-Group1-1870946350: created successfully Sep 07 02:16:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e5e45bcf-fe51-4382-acc7-7a9ad13778d4 tempest-GroupsTest-1080864915 None] Create group completed successfully. Sep 07 02:16:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-65cc73c2-73eb-4572-8e56-a5904865fd03 tempest-GroupsTest-1080864915 None] Group tempest-Group2-1542231447: creating Sep 07 02:16:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-65cc73c2-73eb-4572-8e56-a5904865fd03 tempest-GroupsTest-1080864915 None] Group tempest-Group2-1542231447: created successfully Sep 07 02:16:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-65cc73c2-73eb-4572-8e56-a5904865fd03 tempest-GroupsTest-1080864915 None] Create group completed successfully. Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Flow 'volume_create_manager' (6e67bc3a-a84c-4ef4-a213-65f883913dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac5701d-4ce0-4532-b0bd-e98c4f442358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac5701d-4ce0-4532-b0bd-e98c4f442358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-805426140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e199b8-b494-4482-af1a-6c48e878d2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4309f67f56bf41b68b2459112198f108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:56Z,use_quota=True,user_id='8deab2ee9eac428f9ee5b18abda51ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53c914ba-f301-4328-94d7-a0d4278258ba),volume_type_id=53c914ba-f301-4328-94d7-a0d4278258ba)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b034a58-f67a-465f-8492-7f7baf04e1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b034a58-f67a-465f-8492-7f7baf04e1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af44de1-4d51-4268-a2d0-cb7ec13a4404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af44de1-4d51-4268-a2d0-cb7ec13a4404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e199b8-b494-4482-af1a-6c48e878d2ce', 'volume_name': 'volume-61e199b8-b494-4482-af1a-6c48e878d2ce', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca75ecce-9e2f-4bb3-8023-40be3780eafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca75ecce-9e2f-4bb3-8023-40be3780eafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161943a1-cd08-40c2-9ca0-eaa9c1b54573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:55 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Volume 61e199b8-b494-4482-af1a-6c48e878d2ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e199b8-b494-4482-af1a-6c48e878d2ce', 'volume_size': 1} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-805426140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e199b8-b494-4482-af1a-6c48e878d2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4309f67f56bf41b68b2459112198f108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:56Z,use_quota=True,user_id='8deab2ee9eac428f9ee5b18abda51ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53c914ba-f301-4328-94d7-a0d4278258ba),volume_type_id=53c914ba-f301-4328-94d7-a0d4278258ba)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Creating volume 61e199b8-b494-4482-af1a-6c48e878d2ce {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:16:55 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:16:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:55 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce 1073741824 Sep 07 02:16:55 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Flow 'volume_create_manager' (51bcdecf-eb4a-4c6c-bcb1-cd0aacc77fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925ed13f-86a0-4e62-a941-189a2694640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925ed13f-86a0-4e62-a941-189a2694640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1292771866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d28dc45-8325-4ce8-9223-33e09d39e11e,host='devstack@QuobyteHD#QuobyteHD',id=8c472801-0b31-4373-80d9-a920ef42192a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47226f9a7bb4fc5b0a6e230a5b95348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:56Z,use_quota=True,user_id='36585692fe204b59bca38181b1aba358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db079ae8-91cf-459e-b4ec-89f596c9484b),volume_type_id=db079ae8-91cf-459e-b4ec-89f596c9484b)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4ba759-0b0b-49ad-831f-00779aa9c4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4ba759-0b0b-49ad-831f-00779aa9c4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbadd1b-2cd4-4d3a-a269-5e1b12481050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbadd1b-2cd4-4d3a-a269-5e1b12481050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c472801-0b31-4373-80d9-a920ef42192a', 'volume_name': 'volume-8c472801-0b31-4373-80d9-a920ef42192a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd117f6a-6e43-4efa-8f97-df502212fecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd117f6a-6e43-4efa-8f97-df502212fecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f0c831-4a52-46e3-b2e8-11b37fd9f90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:56 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Volume 8c472801-0b31-4373-80d9-a920ef42192a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c472801-0b31-4373-80d9-a920ef42192a', 'volume_size': 1} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:56 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce 1073741824" returned: 0 in 0.648s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:56 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce Sep 07 02:16:56 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:56 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce" returned: 0 in 0.284s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.691s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2d28dc45-8325-4ce8-9223-33e09d39e11e,created_at=2026-09-07T00:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1292771866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d28dc45-8325-4ce8-9223-33e09d39e11e,host='devstack@QuobyteHD#QuobyteHD',id=8c472801-0b31-4373-80d9-a920ef42192a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47226f9a7bb4fc5b0a6e230a5b95348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:16:56Z,use_quota=True,user_id='36585692fe204b59bca38181b1aba358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db079ae8-91cf-459e-b4ec-89f596c9484b),volume_type_id=db079ae8-91cf-459e-b4ec-89f596c9484b)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Creating volume 8c472801-0b31-4373-80d9-a920ef42192a {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:16:56 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161943a1-cd08-40c2-9ca0-eaa9c1b54573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e199b8-b494-4482-af1a-6c48e878d2ce', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:56 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a 1073741824 Sep 07 02:16:56 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75dd9d7e-8174-4f43-b02e-c8459e1ec789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:56 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Volume volume-61e199b8-b494-4482-af1a-6c48e878d2ce (61e199b8-b494-4482-af1a-6c48e878d2ce): created successfully Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75dd9d7e-8174-4f43-b02e-c8459e1ec789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Flow 'volume_create_manager' (6e67bc3a-a84c-4ef4-a213-65f883913dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-43f876b4-70bd-445a-8eee-b030969e24c2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Created volume successfully. Sep 07 02:16:57 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a 1073741824" returned: 0 in 0.505s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:57 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a Sep 07 02:16:57 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:57 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a" returned: 0 in 0.381s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:16:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f0c831-4a52-46e3-b2e8-11b37fd9f90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c472801-0b31-4373-80d9-a920ef42192a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576bcb30-95ae-4eb4-a9a1-6bce588de6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:16:57 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Volume volume-8c472801-0b31-4373-80d9-a920ef42192a (8c472801-0b31-4373-80d9-a920ef42192a): created successfully Sep 07 02:16:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576bcb30-95ae-4eb4-a9a1-6bce588de6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:16:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Flow 'volume_create_manager' (51bcdecf-eb4a-4c6c-bcb1-cd0aacc77fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:16:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c96dcf46-6800-4c2d-ae6d-2a04cf756fb9 tempest-GroupsTest-1080864915 None] Created volume successfully. Sep 07 02:16:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-99b26fa6-9206-4bf8-943d-173423ce7ee2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:16:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-99b26fa6-9206-4bf8-943d-173423ce7ee2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:16:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-99b26fa6-9206-4bf8-943d-173423ce7ee2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:16:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-99b26fa6-9206-4bf8-943d-173423ce7ee2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:16:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-99b26fa6-9206-4bf8-943d-173423ce7ee2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:16:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-99b26fa6-9206-4bf8-943d-173423ce7ee2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:58 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:16:58 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:58 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-99b26fa6-9206-4bf8-943d-173423ce7ee2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.378s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:58 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-99b26fa6-9206-4bf8-943d-173423ce7ee2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:16:58 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-99b26fa6-9206-4bf8-943d-173423ce7ee2 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Retype volume completed successfully. Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Acquiring lock "cinder-quobyte-8c472801-0b31-4373-80d9-a920ef42192a" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Lock "cinder-quobyte-8c472801-0b31-4373-80d9-a920ef42192a" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3606c6-efc0-425f-98f5-ea46bf495d67]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:59 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a Sep 07 02:16:59 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Acquiring lock "cinder-61e199b8-b494-4482-af1a-6c48e878d2ce-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:59 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a" returned: 0 in 0.469s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "cinder-61e199b8-b494-4482-af1a-6c48e878d2ce-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:59 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a Sep 07 02:16:59 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Acquiring lock "cinder-quobyte-61e199b8-b494-4482-af1a-6c48e878d2ce" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "cinder-quobyte-61e199b8-b494-4482-af1a-6c48e878d2ce" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b7521e-7a19-4a06-98cd-25434690a56e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:16:59 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce Sep 07 02:16:59 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:16:59 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c472801-0b31-4373-80d9-a920ef42192a" returned: 0 in 0.309s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:16:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Lock "cinder-quobyte-8c472801-0b31-4373-80d9-a920ef42192a" released by "delete_volume" :: held 0.828s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Created reservations ['d24d0ad5-1d1c-4a86-bcf7-56e74eb8467e'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:00 devstack cinder-volume[87313]: WARNING cinder.quota [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1299570884 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1299570884, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:17:00 devstack cinder-volume[87313]: WARNING cinder.quota [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1299570884 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1299570884, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Created reservations ['ce11aa8f-1959-4fff-9b42-51127945cf08', 'b97649c7-d5e1-4540-9263-7123232d8b19', '1c965a53-8f80-4821-a48c-396e4c492680', '0c43677f-3c09-4a64-974a-4ecfa8e8299c'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:00 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:17:00 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:00 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce" returned: 0 in 0.561s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:00 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce Sep 07 02:17:00 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:00 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.312s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:17:00 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8eeab4d2-56a4-4f11-a9c4-182c556dc89c tempest-GroupsTest-1080864915 None] Delete group completed successfully. Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-14ff5ba3-cc35-4eb9-9236-3675b7ca1a06 tempest-GroupsTest-1080864915 None] Created reservations ['18fd22dd-bbdb-46fe-b536-407eea686f93'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:00 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61e199b8-b494-4482-af1a-6c48e878d2ce" returned: 0 in 0.347s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "cinder-quobyte-61e199b8-b494-4482-af1a-6c48e878d2ce" released by "delete_volume" :: held 0.960s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14ff5ba3-cc35-4eb9-9236-3675b7ca1a06 tempest-GroupsTest-1080864915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14ff5ba3-cc35-4eb9-9236-3675b7ca1a06 tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-14ff5ba3-cc35-4eb9-9236-3675b7ca1a06 tempest-GroupsTest-1080864915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-14ff5ba3-cc35-4eb9-9236-3675b7ca1a06 tempest-GroupsTest-1080864915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14ff5ba3-cc35-4eb9-9236-3675b7ca1a06 tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-14ff5ba3-cc35-4eb9-9236-3675b7ca1a06 tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:00 devstack cinder-volume[87313]: WARNING cinder.quota [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:17:00 devstack cinder-volume[87313]: WARNING cinder.quota [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:17:00 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:17:00 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Created reservations ['76423504-dd14-4d05-8ad1-16e2967a6823', '8397b55b-890c-4876-8dde-41fda6158266', '3fe96951-820b-4506-95c0-2acfe88f447e', '25459e08-e2cb-4924-aef0-1b36e6e975ee'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:00 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:17:00 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:01 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-14ff5ba3-cc35-4eb9-9236-3675b7ca1a06 tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.382s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:01 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-14ff5ba3-cc35-4eb9-9236-3675b7ca1a06 tempest-GroupsTest-1080864915 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:17:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-14ff5ba3-cc35-4eb9-9236-3675b7ca1a06 tempest-GroupsTest-1080864915 None] Delete group completed successfully. Sep 07 02:17:01 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.320s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:01 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:17:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Deleted volume successfully. Sep 07 02:17:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a946f4a1-ce15-4f61-9c82-03bdc37f79e1 tempest-VolumeRetypeWithoutMigrationTest-170147830 None] Lock "cinder-61e199b8-b494-4482-af1a-6c48e878d2ce-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a19bf90b-f488-4d1e-90db-e709372724fb tempest-GroupsTest-1080864915 None] Group tempest-GroupsTest-Group-9340224: creating Sep 07 02:17:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a19bf90b-f488-4d1e-90db-e709372724fb tempest-GroupsTest-1080864915 None] Group tempest-GroupsTest-Group-9340224: created successfully Sep 07 02:17:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a19bf90b-f488-4d1e-90db-e709372724fb tempest-GroupsTest-1080864915 None] Create group completed successfully. Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Flow 'volume_create_manager' (252a93f3-0e20-4c26-b911-2780fabea991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d6304e-d3d6-4a47-b276-6fc623432949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d6304e-d3d6-4a47-b276-6fc623432949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-250843473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3bbae64-2a91-42d1-acce-03debef62ed4,host='devstack@QuobyteHD#QuobyteHD',id=b4f645df-2e80-4ccb-87e2-6144c3546937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47226f9a7bb4fc5b0a6e230a5b95348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:04Z,use_quota=True,user_id='36585692fe204b59bca38181b1aba358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88a82a1a-1c31-41bd-917c-c30d1554b360),volume_type_id=88a82a1a-1c31-41bd-917c-c30d1554b360)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68946609-7d1e-46ff-8c3c-454af0d288bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68946609-7d1e-46ff-8c3c-454af0d288bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276ca1ce-08f9-44af-8b2b-89c6baa07010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276ca1ce-08f9-44af-8b2b-89c6baa07010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4f645df-2e80-4ccb-87e2-6144c3546937', 'volume_name': 'volume-b4f645df-2e80-4ccb-87e2-6144c3546937', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18db4d12-fb6e-43ee-9dc0-4e6046721c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18db4d12-fb6e-43ee-9dc0-4e6046721c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266b04c1-5b4d-40aa-a3a7-ef488f366e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:04 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Volume b4f645df-2e80-4ccb-87e2-6144c3546937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4f645df-2e80-4ccb-87e2-6144c3546937', 'volume_size': 1} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3bbae64-2a91-42d1-acce-03debef62ed4,created_at=2026-09-07T00:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-250843473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3bbae64-2a91-42d1-acce-03debef62ed4,host='devstack@QuobyteHD#QuobyteHD',id=b4f645df-2e80-4ccb-87e2-6144c3546937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47226f9a7bb4fc5b0a6e230a5b95348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:04Z,use_quota=True,user_id='36585692fe204b59bca38181b1aba358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88a82a1a-1c31-41bd-917c-c30d1554b360),volume_type_id=88a82a1a-1c31-41bd-917c-c30d1554b360)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Creating volume b4f645df-2e80-4ccb-87e2-6144c3546937 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:17:04 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:04 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937 1073741824 Sep 07 02:17:04 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:04 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937 1073741824" returned: 0 in 0.483s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:04 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937 Sep 07 02:17:04 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:05 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937" returned: 0 in 0.258s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:17:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266b04c1-5b4d-40aa-a3a7-ef488f366e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f645df-2e80-4ccb-87e2-6144c3546937', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb77caca-6d6e-456f-a0bc-68a8f6d82ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:05 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Volume volume-b4f645df-2e80-4ccb-87e2-6144c3546937 (b4f645df-2e80-4ccb-87e2-6144c3546937): created successfully Sep 07 02:17:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb77caca-6d6e-456f-a0bc-68a8f6d82ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Flow 'volume_create_manager' (252a93f3-0e20-4c26-b911-2780fabea991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-52d1e586-088f-4ced-b4c1-20c83c1cdcfc tempest-GroupsTest-1080864915 None] Created volume successfully. Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Flow 'volume_create_manager' (606324cb-e8ea-49e9-b556-28211c1f28f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccff23e1-b5f4-4e5b-9995-348a6e66f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccff23e1-b5f4-4e5b-9995-348a6e66f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1493864139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3bbae64-2a91-42d1-acce-03debef62ed4,host='devstack@QuobyteHD#QuobyteHD',id=ab1be07e-dcc4-469f-a501-0691665211cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47226f9a7bb4fc5b0a6e230a5b95348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:06Z,use_quota=True,user_id='36585692fe204b59bca38181b1aba358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88a82a1a-1c31-41bd-917c-c30d1554b360),volume_type_id=88a82a1a-1c31-41bd-917c-c30d1554b360)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34835f03-9a9c-449d-acae-7c41bd842c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34835f03-9a9c-449d-acae-7c41bd842c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c927673-15f1-43bd-add6-a36eecdfa4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c927673-15f1-43bd-add6-a36eecdfa4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1be07e-dcc4-469f-a501-0691665211cb', 'volume_name': 'volume-ab1be07e-dcc4-469f-a501-0691665211cb', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f5dfba-2644-4cd1-a265-fa84aefec9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f5dfba-2644-4cd1-a265-fa84aefec9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e384cd50-6574-4130-88cf-e45f7eb6cd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:06 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Volume ab1be07e-dcc4-469f-a501-0691665211cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1be07e-dcc4-469f-a501-0691665211cb', 'volume_size': 1} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3bbae64-2a91-42d1-acce-03debef62ed4,created_at=2026-09-07T00:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1493864139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3bbae64-2a91-42d1-acce-03debef62ed4,host='devstack@QuobyteHD#QuobyteHD',id=ab1be07e-dcc4-469f-a501-0691665211cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47226f9a7bb4fc5b0a6e230a5b95348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:06Z,use_quota=True,user_id='36585692fe204b59bca38181b1aba358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88a82a1a-1c31-41bd-917c-c30d1554b360),volume_type_id=88a82a1a-1c31-41bd-917c-c30d1554b360)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Creating volume ab1be07e-dcc4-469f-a501-0691665211cb {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:17:06 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:06 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb 1073741824 Sep 07 02:17:06 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:06 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb 1073741824" returned: 0 in 0.614s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:07 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb Sep 07 02:17:07 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:07 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb" returned: 0 in 0.288s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:17:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e384cd50-6574-4130-88cf-e45f7eb6cd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1be07e-dcc4-469f-a501-0691665211cb', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb73047-af1f-47f8-8f06-2dc7ed3726fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:07 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Volume volume-ab1be07e-dcc4-469f-a501-0691665211cb (ab1be07e-dcc4-469f-a501-0691665211cb): created successfully Sep 07 02:17:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb73047-af1f-47f8-8f06-2dc7ed3726fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Flow 'volume_create_manager' (606324cb-e8ea-49e9-b556-28211c1f28f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:07 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-30d587da-852e-4190-9c4c-5cb9ebdc8790 tempest-GroupsTest-1080864915 None] Created volume successfully. Sep 07 02:17:09 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2a180bbb-f862-434c-af67-63eeb69a8a38 tempest-GroupsTest-1080864915 None] Update group completed successfully. Sep 07 02:17:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f7fca003-4132-4671-9bef-bff8fe2eabea tempest-GroupsTest-1080864915 None] Update group completed successfully. Sep 07 02:17:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Acquiring lock "cinder-quobyte-ab1be07e-dcc4-469f-a501-0691665211cb" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Lock "cinder-quobyte-ab1be07e-dcc4-469f-a501-0691665211cb" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:12 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa115d63-e406-4296-878f-878e5397e2d6]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:12 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb Sep 07 02:17:12 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:12 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb" returned: 0 in 0.558s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:12 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb Sep 07 02:17:12 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:13 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ab1be07e-dcc4-469f-a501-0691665211cb" returned: 0 in 0.301s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Lock "cinder-quobyte-ab1be07e-dcc4-469f-a501-0691665211cb" released by "delete_volume" :: held 0.943s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Acquiring lock "cinder-quobyte-b4f645df-2e80-4ccb-87e2-6144c3546937" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Lock "cinder-quobyte-b4f645df-2e80-4ccb-87e2-6144c3546937" acquired by "delete_volume" :: waited 0.034s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:13 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[644c9fb7-6684-4673-915f-2d5a99778a2b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:13 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937 Sep 07 02:17:13 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:13 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937" returned: 0 in 0.533s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:13 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937 Sep 07 02:17:13 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:14 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4f645df-2e80-4ccb-87e2-6144c3546937" returned: 0 in 0.472s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Lock "cinder-quobyte-b4f645df-2e80-4ccb-87e2-6144c3546937" released by "delete_volume" :: held 1.088s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:14 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Created reservations ['7ab5252a-aebb-4661-82b2-be9a8568f189'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:14 devstack cinder-volume[87313]: WARNING cinder.quota [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2060013707 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2060013707, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:17:14 devstack cinder-volume[87313]: WARNING cinder.quota [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2060013707 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2060013707, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:17:14 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Created reservations ['9210e0ca-b983-4455-bdf7-a080ce5b607d', '7cf9b182-cb2a-44ba-9354-9f693c7d09eb', '921b0e47-9ac0-46e3-abdd-37fb38f81631', '54160420-b6fa-4119-a470-6290c8366715'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:14 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Created reservations ['cd4f96de-3f2e-4c35-9eb0-061fe1af3369', 'cac7f143-62cf-4128-93c2-6283b23f9b36', '76f2631d-569c-4347-8e8d-cbc42530df63', '5ad35de8-8047-4481-9910-2204b3cd61ce'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:15 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:17:15 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:15 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.291s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:17:15 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-762d7910-b852-4aff-9310-56ae750aed42 tempest-GroupsTest-1080864915 None] Delete group completed successfully. Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Flow 'volume_create_manager' (2b082f09-a316-4207-9136-7fb39482ba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3211f19-cec1-4d2b-a706-366bdaa020bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3211f19-cec1-4d2b-a706-366bdaa020bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-731603237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce97149-f154-4391-838d-f02f188e7ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef69a4af43ea4352a7264535126617a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:16Z,use_quota=True,user_id='984e0ec53c684331baa76e320c25983b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47e71a8-fcae-4a4f-afe7-d4c3e3454e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47e71a8-fcae-4a4f-afe7-d4c3e3454e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ece4dd7-bc66-45f1-977d-849c93d08465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ece4dd7-bc66-45f1-977d-849c93d08465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce97149-f154-4391-838d-f02f188e7ec1', 'volume_name': 'volume-4ce97149-f154-4391-838d-f02f188e7ec1', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd4f3ba-94e3-44c7-ae1d-897181d71d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd4f3ba-94e3-44c7-ae1d-897181d71d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4089b8-cf68-4156-bcc7-bbac293d9059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:15 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Volume 4ce97149-f154-4391-838d-f02f188e7ec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce97149-f154-4391-838d-f02f188e7ec1', 'volume_size': 1} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-731603237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce97149-f154-4391-838d-f02f188e7ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef69a4af43ea4352a7264535126617a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:16Z,use_quota=True,user_id='984e0ec53c684331baa76e320c25983b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Creating volume 4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:17:15 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:17:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:15 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 1073741824 Sep 07 02:17:15 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:16 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 1073741824" returned: 0 in 0.595s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:16 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 Sep 07 02:17:16 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:16 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1" returned: 0 in 0.307s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:17:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4089b8-cf68-4156-bcc7-bbac293d9059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce97149-f154-4391-838d-f02f188e7ec1', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03427a-a90d-4cf9-8e99-54b577bb2f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:16 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Volume volume-4ce97149-f154-4391-838d-f02f188e7ec1 (4ce97149-f154-4391-838d-f02f188e7ec1): created successfully Sep 07 02:17:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03427a-a90d-4cf9-8e99-54b577bb2f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Flow 'volume_create_manager' (2b082f09-a316-4207-9136-7fb39482ba04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:16 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-02df0d2a-bfeb-441f-8f28-7cad2b9ae59d tempest-VolumesDeleteCascade-1954200033 None] Created volume successfully. Sep 07 02:17:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] Creating offline snapshot e73e5283-d657-43da-85c3-3bbbfa31bd8e of volume 4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:17:18 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a0e16a-8d87-4932-a4a9-b5f7b222d852]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:18 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 Sep 07 02:17:18 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:18 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1" returned: 0 in 0.499s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:18 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e 1G Sep 07 02:17:18 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:19 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e 1G" returned: 0 in 0.576s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce97149-f154-4391-838d-f02f188e7ec1 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:19 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce97149-f154-4391-838d-f02f188e7ec1 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e Sep 07 02:17:19 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:19 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce97149-f154-4391-838d-f02f188e7ec1 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e" returned: 0 in 0.433s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:19 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e is being set with open permissions: ugo+rw Sep 07 02:17:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:19 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e Sep 07 02:17:19 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:19 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e" returned: 0 in 0.334s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:19 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.info Sep 07 02:17:19 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:20 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.info" returned: 0 in 0.359s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:20 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.info is being set with open permissions: ugo+rw Sep 07 02:17:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:20 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.info Sep 07 02:17:20 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:20 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.info" returned: 0 in 0.271s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.602s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:20 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-92c8e3e2-71ef-4db7-b220-30f9d1bc0d9d tempest-VolumesDeleteCascade-1954200033 None] Create snapshot completed successfully Sep 07 02:17:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] Creating offline snapshot e8e7bc96-a928-456b-bb14-178721022487 of volume 4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:17:21 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee46e54-7e9d-42b7-91bc-5cda3a1fb4f5]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:21 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e Sep 07 02:17:21 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:22 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e" returned: 0 in 0.530s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce97149-f154-4391-838d-f02f188e7ec1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:17:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:22 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 1G Sep 07 02:17:22 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:22 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 1G" returned: 0 in 0.587s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:22 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 Sep 07 02:17:22 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:23 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487" returned: 0 in 0.675s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:23 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 is being set with open permissions: ugo+rw Sep 07 02:17:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:23 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 Sep 07 02:17:23 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:23 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487" returned: 0 in 0.456s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.424s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:23 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=81,cinder:UPDATE=110,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:17:23 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-25cf0027-de20-416c-b909-36776b5e6aa6 tempest-VolumesDeleteCascade-1954200033 None] Create snapshot completed successfully Sep 07 02:17:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-4ce97149-f154-4391-838d-f02f188e7ec1-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-4ce97149-f154-4391-838d-f02f188e7ec1-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Performing cascade delete. {{(pid=87313) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-e73e5283-d657-43da-85c3-3bbbfa31bd8e-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-e73e5283-d657-43da-85c3-3bbbfa31bd8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-quobyte-4ce97149-f154-4391-838d-f02f188e7ec1" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-4ce97149-f154-4391-838d-f02f188e7ec1" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-quobyte-e73e5283-d657-43da-85c3-3bbbfa31bd8e" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-e73e5283-d657-43da-85c3-3bbbfa31bd8e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Deleting offline snapshot e73e5283-d657-43da-85c3-3bbbfa31bd8e of volume 4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] snapshot_file for this snap is: volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[44863eb0-105a-4670-9627-5f851c3a43ad]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:25 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e Sep 07 02:17:25 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:25 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e" returned: 0 in 0.533s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce97149-f154-4391-838d-f02f188e7ec1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4c8ebf-0cb6-43d6-8235-6bf1c5845939]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:26 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 Sep 07 02:17:26 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:26 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:17:26 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:26 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1" returned: 0 in 0.634s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f2f6a1-319e-476b-8899-e59369d8b4d6]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:26 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.428s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 8 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:17:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:17:26 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 Sep 07 02:17:26 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4f1cdfcf-e481-4108-894a-594f820e11ac tempest-GroupsV314Test-1608411207 None] Group tempest-GroupsV314Test-Group-1281452723: creating Sep 07 02:17:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4f1cdfcf-e481-4108-894a-594f820e11ac tempest-GroupsV314Test-1608411207 None] Group tempest-GroupsV314Test-Group-1281452723: created successfully Sep 07 02:17:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4f1cdfcf-e481-4108-894a-594f820e11ac tempest-GroupsV314Test-1608411207 None] Create group completed successfully. Sep 07 02:17:27 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487" returned: 0 in 0.631s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce97149-f154-4391-838d-f02f188e7ec1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:17:27 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbad5534-2792-4859-9703-33ba603e5346]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:27 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e Sep 07 02:17:27 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:27 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e" returned: 0 in 0.477s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce97149-f154-4391-838d-f02f188e7ec1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:17:27 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5071482-616b-4b6f-af3f-ae6e0c139b4b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:27 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 Sep 07 02:17:27 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:28 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1" returned: 0 in 0.691s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:28 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e Sep 07 02:17:28 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:29 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e" returned: 0 in 0.623s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:29 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e Sep 07 02:17:29 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Flow 'volume_create_manager' (b6668fb2-91ed-432a-8f0e-88b2ecaa6436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140fd470-5526-43a0-aa9c-827876890c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140fd470-5526-43a0-aa9c-827876890c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-100540296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e77c51d-1bf3-4cd6-98d2-e4c8f27d8dda,host='devstack@QuobyteHD#QuobyteHD',id=08d0c8d4-1148-437b-afde-81a0ab46e1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6843f8b80f544776b97737dd7cc0bc2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:29Z,use_quota=True,user_id='351ee91066d949bcab8540a22506b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49b1b38a-b6ec-4b3c-b88b-26ae776f5b2b),volume_type_id=49b1b38a-b6ec-4b3c-b88b-26ae776f5b2b)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2c5909-18df-4fba-84a0-75a62a94687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2c5909-18df-4fba-84a0-75a62a94687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5456a5a1-2cea-4ded-9ad6-753774010cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5456a5a1-2cea-4ded-9ad6-753774010cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d0c8d4-1148-437b-afde-81a0ab46e1a0', 'volume_name': 'volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a600f1f-ab7e-4ae3-862a-7ae0090f9d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a600f1f-ab7e-4ae3-862a-7ae0090f9d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d707ec-a19b-4c4f-893c-bdf28e6bc4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:29 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Volume 08d0c8d4-1148-437b-afde-81a0ab46e1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0', 'volume_size': 1} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e77c51d-1bf3-4cd6-98d2-e4c8f27d8dda,created_at=2026-09-07T00:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-100540296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e77c51d-1bf3-4cd6-98d2-e4c8f27d8dda,host='devstack@QuobyteHD#QuobyteHD',id=08d0c8d4-1148-437b-afde-81a0ab46e1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6843f8b80f544776b97737dd7cc0bc2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:29Z,use_quota=True,user_id='351ee91066d949bcab8540a22506b0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49b1b38a-b6ec-4b3c-b88b-26ae776f5b2b),volume_type_id=49b1b38a-b6ec-4b3c-b88b-26ae776f5b2b)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Creating volume 08d0c8d4-1148-437b-afde-81a0ab46e1a0 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:17:29 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:29 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e73e5283-d657-43da-85c3-3bbbfa31bd8e" returned: 0 in 0.494s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce97149-f154-4391-838d-f02f188e7ec1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 -F qcow2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:29 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 1073741824 Sep 07 02:17:29 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:29 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce97149-f154-4391-838d-f02f188e7ec1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 -F qcow2 Sep 07 02:17:29 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:30 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ce97149-f154-4391-838d-f02f188e7ec1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 -F qcow2" returned: 0 in 0.536s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-e73e5283-d657-43da-85c3-3bbbfa31bd8e" released by "_delete_snapshot" :: held 4.936s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-4ce97149-f154-4391-838d-f02f188e7ec1" released by "delete_snapshot" :: held 4.981s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:30 devstack cinder-volume[87313]: WARNING cinder.quota [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Created reservations ['c98a1c33-4f38-4f0b-a2ed-2a6ff9470535', '73eb31d8-8877-4412-9d9a-766898b63f87', '92870e52-b307-4fae-b505-e4fdbc0354e9', 'a37e6ce6-7b70-4861-9397-db578e9c2254'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:30 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 1073741824" returned: 0 in 0.874s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:30 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Delete snapshot completed successfully. Sep 07 02:17:30 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 Sep 07 02:17:30 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-e73e5283-d657-43da-85c3-3bbbfa31bd8e-delete_snapshot" released by "delete_snapshot" :: held 5.430s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-e8e7bc96-a928-456b-bb14-178721022487-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-e8e7bc96-a928-456b-bb14-178721022487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-quobyte-4ce97149-f154-4391-838d-f02f188e7ec1" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-4ce97149-f154-4391-838d-f02f188e7ec1" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-quobyte-e8e7bc96-a928-456b-bb14-178721022487" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-e8e7bc96-a928-456b-bb14-178721022487" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Deleting offline snapshot e8e7bc96-a928-456b-bb14-178721022487 of volume 4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] snapshot_file for this snap is: volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b876d9-da42-4925-994d-02c4f94e9c80]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0" returned: 0 in 0.419s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:17:30 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d707ec-a19b-4c4f-893c-bdf28e6bc4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb05c935-a5b5-471e-9f61-6ace5d238999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:30 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Volume volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 (08d0c8d4-1148-437b-afde-81a0ab46e1a0): created successfully Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb05c935-a5b5-471e-9f61-6ace5d238999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Flow 'volume_create_manager' (b6668fb2-91ed-432a-8f0e-88b2ecaa6436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-47413128-2dd3-4e38-921a-95002f325e8f tempest-GroupsV314Test-1608411207 None] Created volume successfully. Sep 07 02:17:31 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 Sep 07 02:17:31 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:31 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487" returned: 0 in 0.487s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce97149-f154-4391-838d-f02f188e7ec1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:17:31 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebb58d0-29e6-4b31-bf21-3ad76c03323a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:31 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 Sep 07 02:17:31 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:31 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1" returned: 0 in 0.380s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:31 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 Sep 07 02:17:31 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:32 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487" returned: 0 in 0.478s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:32 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487 Sep 07 02:17:32 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:32 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1.e8e7bc96-a928-456b-bb14-178721022487" returned: 0 in 0.634s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-e8e7bc96-a928-456b-bb14-178721022487" released by "_delete_snapshot" :: held 2.239s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-4ce97149-f154-4391-838d-f02f188e7ec1" released by "delete_snapshot" :: held 2.305s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:33 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Cloning volume 08d0c8d4-1148-437b-afde-81a0ab46e1a0 to volume e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Creating offline snapshot b98e5d00-544d-40ad-9fc9-3db97e4b0a0f of volume 08d0c8d4-1148-437b-afde-81a0ab46e1a0 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbbdc88-d8f9-4d78-b1db-cee55269ed22]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Created reservations ['024d0a9e-9925-4648-998a-4ed721e1fea3', '7f2b40f9-d555-4e49-ae63-2e764068e606', '4bfbf9f6-d33b-48a0-8747-c5f25b816fd1', 'f5f5b26b-c46c-4a0f-be46-1138913cae01'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:33 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Delete snapshot completed successfully. Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-e8e7bc96-a928-456b-bb14-178721022487-delete_snapshot" released by "delete_snapshot" :: held 2.979s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Snapshots deleted, issuing volume delete {{(pid=87313) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-quobyte-4ce97149-f154-4391-838d-f02f188e7ec1" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-4ce97149-f154-4391-838d-f02f188e7ec1" acquired by "delete_volume" :: waited 0.042s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7429db-7299-41d9-a428-e1a35792e908]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:33 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 Sep 07 02:17:33 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:34 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 Sep 07 02:17:34 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:34 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1" returned: 0 in 1.035s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:34 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1 Sep 07 02:17:34 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:34 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0" returned: 0 in 1.692s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:35 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f 1G Sep 07 02:17:35 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:35 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4ce97149-f154-4391-838d-f02f188e7ec1" returned: 0 in 0.535s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-4ce97149-f154-4391-838d-f02f188e7ec1" released by "delete_volume" :: held 1.736s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:35 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Created reservations ['782ace30-370c-4744-ae4a-4d430fc56e94', 'd3888db6-5d3a-4a9a-91b0-f5bffe8b13aa', '759bdb64-e945-468b-9363-2f3e4bcab32b', 'f00c3f2c-956d-429a-96a9-b31772bd5c7f'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:35 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:17:35 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:35 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f 1G" returned: 0 in 0.901s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:35 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f Sep 07 02:17:35 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:36 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.487s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:36 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:17:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Deleted volume successfully. Sep 07 02:17:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64c5eac9-e2f3-4b0b-8eb3-2197aea6d9d6 tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-4ce97149-f154-4391-838d-f02f188e7ec1-delete_volume" released by "delete_volume" :: held 11.225s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:36 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f" returned: 0 in 0.668s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:36 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:17:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:36 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f Sep 07 02:17:36 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:36 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f" returned: 0 in 0.398s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:37 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.info Sep 07 02:17:37 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:37 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.info" returned: 0 in 0.435s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:37 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:17:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:37 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.info Sep 07 02:17:37 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:37 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.info" returned: 0 in 0.527s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Acquiring lock "cinder-quobyte-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Lock "cinder-quobyte-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] snapshot: b98e5d00-544d-40ad-9fc9-3db97e4b0a0f, volume: e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d8f774-0cb7-4c32-ab6a-4f7bad18464b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Flow 'volume_create_manager' (bb7638a1-326b-47dd-84ac-baebeb0050a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5102740f-82e6-4a2e-8f96-aeec5e5388d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5102740f-82e6-4a2e-8f96-aeec5e5388d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-248106830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a387bdf-e489-4f55-a4bb-331876c8eec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef69a4af43ea4352a7264535126617a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:38Z,use_quota=True,user_id='984e0ec53c684331baa76e320c25983b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65c4c2d-372d-4134-940d-d6be36d8afea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65c4c2d-372d-4134-940d-d6be36d8afea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:38 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f Sep 07 02:17:38 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01648903-898e-48b5-a90e-4ede35470cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01648903-898e-48b5-a90e-4ede35470cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a387bdf-e489-4f55-a4bb-331876c8eec6', 'volume_name': 'volume-1a387bdf-e489-4f55-a4bb-331876c8eec6', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa8e390-c284-4cd7-ae86-3876234e8e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa8e390-c284-4cd7-ae86-3876234e8e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1191bcbf-5231-4a8f-8165-81f6989388c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:38 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Volume 1a387bdf-e489-4f55-a4bb-331876c8eec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a387bdf-e489-4f55-a4bb-331876c8eec6', 'volume_size': 1} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:38 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f" returned: 0 in 0.516s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95f175-9861-431b-9a98-2ab530936469]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:38 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 Sep 07 02:17:38 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:39 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0" returned: 0 in 0.515s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:17:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:17:39 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:17:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:39 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 Sep 07 02:17:39 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:44 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01" returned: 0 in 4.906s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:17:44 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Converted 1024.00 MB image at 208.67 MB/s Sep 07 02:17:44 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:44 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 Sep 07 02:17:44 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:44 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01" returned: 0 in 0.291s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Lock "cinder-quobyte-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01" released by "_copy_volume_from_snapshot" :: held 6.352s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Acquiring lock "cinder-quobyte-b98e5d00-544d-40ad-9fc9-3db97e4b0a0f" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Lock "cinder-quobyte-b98e5d00-544d-40ad-9fc9-3db97e4b0a0f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Deleting offline snapshot b98e5d00-544d-40ad-9fc9-3db97e4b0a0f of volume 08d0c8d4-1148-437b-afde-81a0ab46e1a0 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] snapshot_file for this snap is: volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[717cec9e-6241-49ff-a4a6-fd28610ba8ec]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:44 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f Sep 07 02:17:44 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:44 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f" returned: 0 in 0.470s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c94b63-2df6-4e4b-94b0-fef3ee737db4]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:45 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 Sep 07 02:17:45 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:45 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0" returned: 0 in 0.498s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:45 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f Sep 07 02:17:45 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:45 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f" returned: 0 in 0.428s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:45 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f Sep 07 02:17:45 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:46 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0.b98e5d00-544d-40ad-9fc9-3db97e4b0a0f" returned: 0 in 0.264s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Lock "cinder-quobyte-b98e5d00-544d-40ad-9fc9-3db97e4b0a0f" released by "_delete_snapshot" :: held 1.757s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.171s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.871s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-248106830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a387bdf-e489-4f55-a4bb-331876c8eec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef69a4af43ea4352a7264535126617a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:38Z,use_quota=True,user_id='984e0ec53c684331baa76e320c25983b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Creating volume 1a387bdf-e489-4f55-a4bb-331876c8eec6 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:17:46 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:46 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 1073741824 Sep 07 02:17:46 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:46 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-42dec4e5-b197-4e88-9cfe-660724f347e6 tempest-GroupsV314Test-1608411207 None] Create group from source-group-2e77c51d-1bf3-4cd6-98d2-e4c8f27d8dda completed successfully. Sep 07 02:17:46 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 1073741824" returned: 0 in 0.435s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:46 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 Sep 07 02:17:46 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:47 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6" returned: 0 in 0.328s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1191bcbf-5231-4a8f-8165-81f6989388c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a387bdf-e489-4f55-a4bb-331876c8eec6', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793c4152-33de-46d0-b940-67656a3b30f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:47 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Volume volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 (1a387bdf-e489-4f55-a4bb-331876c8eec6): created successfully Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793c4152-33de-46d0-b940-67656a3b30f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Flow 'volume_create_manager' (bb7638a1-326b-47dd-84ac-baebeb0050a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:47 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9667b590-a64d-40d4-94e7-6781639b198b tempest-VolumesDeleteCascade-1954200033 None] Created volume successfully. Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Acquiring lock "cinder-quobyte-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Lock "cinder-quobyte-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a37883-d8bd-47d9-85ca-0025da66264b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:47 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 Sep 07 02:17:47 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:47 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01" returned: 0 in 0.394s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:47 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01 Sep 07 02:17:47 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:48 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01" returned: 0 in 0.290s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Lock "cinder-quobyte-e9ca3e6a-49c9-4f04-bc06-6c0fc7417a01" released by "delete_volume" :: held 0.724s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] Creating offline snapshot 693b772d-afb3-40a3-858d-dfc10b9d99fc of volume 1a387bdf-e489-4f55-a4bb-331876c8eec6 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95d4b9c-1e62-4c22-9d0f-dea85c401e27]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Created reservations ['17e1ea6d-eef2-4ee4-ad82-12e33148be39'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:48 devstack cinder-volume[87313]: WARNING cinder.quota [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-767269248 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-767269248, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:17:48 devstack cinder-volume[87313]: WARNING cinder.quota [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-767269248 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-767269248, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Created reservations ['792ba3ac-d28f-4567-8207-3411a652a195', '2115e770-7dee-4394-8b9a-88c3180ccf78', '3aba7f9b-5d14-457b-9221-84f6aa0ab733', 'fb69e44c-6e56-4b95-afa0-ca834f56b7fc'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:48 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 Sep 07 02:17:48 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:48 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:17:48 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:48 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6" returned: 0 in 0.397s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:48 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc 1G Sep 07 02:17:48 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:48 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.298s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:48 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:17:48 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3e8eea4a-262e-4388-b60f-76de1321497a tempest-GroupsV314Test-1608411207 None] Delete group completed successfully. Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Acquiring lock "cinder-quobyte-08d0c8d4-1148-437b-afde-81a0ab46e1a0" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Lock "cinder-quobyte-08d0c8d4-1148-437b-afde-81a0ab46e1a0" acquired by "delete_volume" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[860142d2-68f5-4b52-87d2-ca7d4de1432a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:49 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc 1G" returned: 0 in 0.427s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:49 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc Sep 07 02:17:49 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:49 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 Sep 07 02:17:49 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:49 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc" returned: 0 in 0.334s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:49 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc is being set with open permissions: ugo+rw Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:49 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0" returned: 0 in 0.387s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:49 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc Sep 07 02:17:49 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:49 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0 Sep 07 02:17:49 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:49 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc" returned: 0 in 0.271s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:49 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.info Sep 07 02:17:49 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:49 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08d0c8d4-1148-437b-afde-81a0ab46e1a0" returned: 0 in 0.350s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Lock "cinder-quobyte-08d0c8d4-1148-437b-afde-81a0ab46e1a0" released by "delete_volume" :: held 0.813s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:49 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Created reservations ['80cb5026-c4a2-4804-b8f9-e88ee4e27347'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Created reservations ['a881091f-18a1-4cd3-b7c7-b5759e200703', '58aa9a02-0774-4a74-b2eb-e9491966f798', 'c4c37599-6e50-4017-80c7-762cfddf7886', 'e5f2126a-eaa1-4917-a58b-aa21caa51d04'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:17:50 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.info" returned: 0 in 0.325s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:50 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.info is being set with open permissions: ugo+rw Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:50 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.info Sep 07 02:17:50 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:50 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:17:50 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:50 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.330s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:17:50 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-50cdf8e0-4846-482e-a05c-5c965f89b222 tempest-GroupsV314Test-1608411207 None] Delete group completed successfully. Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.info" returned: 0 in 0.399s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-793d2b31-9519-4b7b-aa87-5b0d2b5761ee tempest-VolumesDeleteCascade-1954200033 None] Create snapshot completed successfully Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Flow 'volume_create_manager' (92ae2000-8796-45cf-9c6a-81a73c35fe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457c8d4b-0940-44a1-b5f9-3230d277c32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457c8d4b-0940-44a1-b5f9-3230d277c32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-278151907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c1f8fc-a43d-4c87-a70e-f844f11cb018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d00d1cfc5364250911da720ea0ed2db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:51Z,use_quota=True,user_id='3da4d81a3b164ed591a81288a84156a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9d854e-0b18-45a7-a85b-f1cd28e69e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9d854e-0b18-45a7-a85b-f1cd28e69e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3788c1f-3ef2-481f-a4f3-68b1cf28fe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3788c1f-3ef2-481f-a4f3-68b1cf28fe1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c1f8fc-a43d-4c87-a70e-f844f11cb018', 'volume_name': 'volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444b7d7b-8d34-4569-add3-e2a3a99362da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444b7d7b-8d34-4569-add3-e2a3a99362da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75e6cc5-6a1c-4f41-b9e9-2d8bcb9bd8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:50 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Volume 41c1f8fc-a43d-4c87-a70e-f844f11cb018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018', 'volume_size': 1} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-278151907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c1f8fc-a43d-4c87-a70e-f844f11cb018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d00d1cfc5364250911da720ea0ed2db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:51Z,use_quota=True,user_id='3da4d81a3b164ed591a81288a84156a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Creating volume 41c1f8fc-a43d-4c87-a70e-f844f11cb018 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:17:50 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:17:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:50 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018 1073741824 Sep 07 02:17:50 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:51 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018 1073741824" returned: 0 in 0.444s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:51 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018 Sep 07 02:17:51 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:51 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018" returned: 0 in 0.283s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:17:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75e6cc5-6a1c-4f41-b9e9-2d8bcb9bd8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b734c4f4-5248-4b04-91f1-fe994eaa5277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:51 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Volume volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018 (41c1f8fc-a43d-4c87-a70e-f844f11cb018): created successfully Sep 07 02:17:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b734c4f4-5248-4b04-91f1-fe994eaa5277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Flow 'volume_create_manager' (92ae2000-8796-45cf-9c6a-81a73c35fe34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:51 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e11f23ba-22e6-41ce-ac8b-28689b06753d tempest-AttachVolumeShelveTestJSON-860885807 None] Created volume successfully. Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Flow 'volume_create_manager' (3a679d0b-6f38-4ad2-bc6a-13247ca76b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4054b0-c825-462a-bae8-b28883beb247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4054b0-c825-462a-bae8-b28883beb247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1486828912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656dee96-de6e-49c9-9c05-6fd5fdc6b8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef69a4af43ea4352a7264535126617a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=693b772d-afb3-40a3-858d-dfc10b9d99fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:17:52Z,use_quota=True,user_id='984e0ec53c684331baa76e320c25983b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d11f17-74df-46d5-920c-91a903be1977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d11f17-74df-46d5-920c-91a903be1977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d2aca0-baa2-44f6-aecf-3c524322637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d2aca0-baa2-44f6-aecf-3c524322637c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '656dee96-de6e-49c9-9c05-6fd5fdc6b8d1', 'volume_name': 'volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1', 'volume_size': 1, 'snapshot_id': '693b772d-afb3-40a3-858d-dfc10b9d99fc'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f8f6b7-73f7-4d18-b37a-dad25aac3453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f8f6b7-73f7-4d18-b37a-dad25aac3453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63acf19f-415f-40d5-9f14-93e934fa1e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:52 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Volume 656dee96-de6e-49c9-9c05-6fd5fdc6b8d1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1', 'volume_size': 1, 'snapshot_id': '693b772d-afb3-40a3-858d-dfc10b9d99fc'} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-quobyte-693b772d-afb3-40a3-858d-dfc10b9d99fc-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" by "_create_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-693b772d-afb3-40a3-858d-dfc10b9d99fc-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Creating volume 656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 from snapshot 693b772d-afb3-40a3-858d-dfc10b9d99fc {{(pid=87313) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-quobyte-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] snapshot: 693b772d-afb3-40a3-858d-dfc10b9d99fc, volume: 656dee96-de6e-49c9-9c05-6fd5fdc6b8d1, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc73c0ab-6c80-47db-b869-066851d6ab37]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:52 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc Sep 07 02:17:52 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:52 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc" returned: 0 in 0.403s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a387bdf-e489-4f55-a4bb-331876c8eec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f123b408-d15c-456a-9461-71a7cbb34260]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:17:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:52 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 Sep 07 02:17:52 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:53 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6" returned: 0 in 0.422s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:17:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:17:53 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:17:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:53 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 Sep 07 02:17:53 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:59 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" returned: 0 in 5.961s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:17:59 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Converted 1024.00 MB image at 171.72 MB/s Sep 07 02:17:59 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 is being set with open permissions: ugo+rw Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:17:59 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 Sep 07 02:17:59 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:17:59 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" returned: 0 in 0.303s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" released by "_copy_volume_from_snapshot" :: held 7.192s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=119,cinder:UPDATE=132,cinder:INSERT=32,cinder:DELETE=5 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-693b772d-afb3-40a3-858d-dfc10b9d99fc-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" released by "_create_volume_from_snapshot" :: held 7.274s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.294s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63acf19f-415f-40d5-9f14-93e934fa1e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1', 'volume_size': 1, 'snapshot_id': '693b772d-afb3-40a3-858d-dfc10b9d99fc'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36504ad-8a23-41eb-98d2-cc84f86ef7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:17:59 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Volume volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 (656dee96-de6e-49c9-9c05-6fd5fdc6b8d1): created successfully Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36504ad-8a23-41eb-98d2-cc84f86ef7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:17:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Flow 'volume_create_manager' (3a679d0b-6f38-4ad2-bc6a-13247ca76b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:17:59 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7dba6e92-a811-44ac-ac44-2e7a2cfe931f tempest-VolumesDeleteCascade-1954200033 None] Created volume successfully. Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-1a387bdf-e489-4f55-a4bb-331876c8eec6-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-1a387bdf-e489-4f55-a4bb-331876c8eec6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Performing cascade delete. {{(pid=87313) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-693b772d-afb3-40a3-858d-dfc10b9d99fc-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-693b772d-afb3-40a3-858d-dfc10b9d99fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-quobyte-1a387bdf-e489-4f55-a4bb-331876c8eec6" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-1a387bdf-e489-4f55-a4bb-331876c8eec6" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-quobyte-693b772d-afb3-40a3-858d-dfc10b9d99fc" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-693b772d-afb3-40a3-858d-dfc10b9d99fc" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Deleting offline snapshot 693b772d-afb3-40a3-858d-dfc10b9d99fc of volume 1a387bdf-e489-4f55-a4bb-331876c8eec6 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] snapshot_file for this snap is: volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Flow 'volume_create_manager' (53fe5a41-da90-48c6-8c11-332b5b13f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d21e2ed-eb69-4801-bcbb-36a57ea7c565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6703d5a-660b-4a29-912d-2e6ea7659014]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d21e2ed-eb69-4801-bcbb-36a57ea7c565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-230696007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d9f32c-e941-42a5-8bc8-7936ed3bc241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d6202321e84a9e9fc04be38d8e1ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:00Z,use_quota=True,user_id='64091428132d4c5bbd76fe4a271dbcff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae825f3c-d7a6-4866-a7fd-e4a71e61a64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae825f3c-d7a6-4866-a7fd-e4a71e61a64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51092017-ea6a-4090-803d-89232034555f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51092017-ea6a-4090-803d-89232034555f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d9f32c-e941-42a5-8bc8-7936ed3bc241', 'volume_name': 'volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2d8b5e-65db-4e68-b6c6-3b4e0df664c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2d8b5e-65db-4e68-b6c6-3b4e0df664c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00035517-5f87-423c-883b-282253ef2a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:00 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241', 'volume_size': 1} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-230696007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d9f32c-e941-42a5-8bc8-7936ed3bc241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d6202321e84a9e9fc04be38d8e1ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:00Z,use_quota=True,user_id='64091428132d4c5bbd76fe4a271dbcff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Creating volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:18:00 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:00 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 1073741824 Sep 07 02:18:00 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:00 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc Sep 07 02:18:00 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:00 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc" returned: 0 in 0.417s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a387bdf-e489-4f55-a4bb-331876c8eec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4136aa-95c1-456b-a46a-71eab47d02f2]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:01 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 1073741824" returned: 0 in 0.558s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:01 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 Sep 07 02:18:01 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:01 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 Sep 07 02:18:01 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Flow 'volume_create_manager' (f21b49c5-67ef-4226-912b-b578d4ed857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98546889-e927-402f-aefe-3d49450c9d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98546889-e927-402f-aefe-3d49450c9d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-615052858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbb4357-67bd-45a8-8a73-626a6e53897f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c1a0819d6a40b79b7494c3e204ff49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:01Z,use_quota=True,user_id='e9485cf921c24a959fc443d7cd5eaa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b77d66-be2e-46f1-b78c-d22a3b8d8cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b77d66-be2e-46f1-b78c-d22a3b8d8cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd002381-62c4-483c-89cc-936499c6d21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd002381-62c4-483c-89cc-936499c6d21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbb4357-67bd-45a8-8a73-626a6e53897f', 'volume_name': 'volume-bcbb4357-67bd-45a8-8a73-626a6e53897f', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b834ad02-4dee-41b8-a5be-6cc316bb48c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b834ad02-4dee-41b8-a5be-6cc316bb48c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ead9e3-36f2-4b0e-b533-5bc1ace6343c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:01 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Volume bcbb4357-67bd-45a8-8a73-626a6e53897f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbb4357-67bd-45a8-8a73-626a6e53897f', 'volume_size': 1} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:01 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241" returned: 0 in 0.468s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.100s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-615052858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbb4357-67bd-45a8-8a73-626a6e53897f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c1a0819d6a40b79b7494c3e204ff49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:01Z,use_quota=True,user_id='e9485cf921c24a959fc443d7cd5eaa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Creating volume bcbb4357-67bd-45a8-8a73-626a6e53897f {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:18:01 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:01 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f 1073741824 Sep 07 02:18:01 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00035517-5f87-423c-883b-282253ef2a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d90cf5-0532-4905-99ba-aac2766155c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:01 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6" returned: 0 in 0.802s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:01 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Volume volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 (78d9f32c-e941-42a5-8bc8-7936ed3bc241): created successfully Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d90cf5-0532-4905-99ba-aac2766155c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:01 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc Sep 07 02:18:01 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Flow 'volume_create_manager' (53fe5a41-da90-48c6-8c11-332b5b13f021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-602912aa-c153-4815-bc93-2e7c01297bd9 tempest-SnapshotsActionsTest-692920182 None] Created volume successfully. Sep 07 02:18:02 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f 1073741824" returned: 0 in 0.549s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:02 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc" returned: 0 in 0.512s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:02 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc Sep 07 02:18:02 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:02 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f Sep 07 02:18:02 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:02 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6.693b772d-afb3-40a3-858d-dfc10b9d99fc" returned: 0 in 0.299s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-693b772d-afb3-40a3-858d-dfc10b9d99fc" released by "_delete_snapshot" :: held 2.193s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-1a387bdf-e489-4f55-a4bb-331876c8eec6" released by "delete_snapshot" :: held 2.247s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:02 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f" returned: 0 in 0.352s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ead9e3-36f2-4b0e-b533-5bc1ace6343c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbb4357-67bd-45a8-8a73-626a6e53897f', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7048f97-6b37-48e1-9a48-6494b8b1662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:02 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Volume volume-bcbb4357-67bd-45a8-8a73-626a6e53897f (bcbb4357-67bd-45a8-8a73-626a6e53897f): created successfully Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7048f97-6b37-48e1-9a48-6494b8b1662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Flow 'volume_create_manager' (f21b49c5-67ef-4226-912b-b578d4ed857e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2e0ddabb-bd54-4b98-bd6c-b221c413ca0d tempest-ServerActionsTestOtherA-678111813 None] Created volume successfully. Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Created reservations ['822f572f-c397-477a-b5bb-50d52e5ce1bf', '3fabaf9c-238a-4d9b-bb74-393e3d539172', '60662b5c-a1cf-40a0-920b-12d6547ed324', '90fe1f75-4820-480a-b9f5-c13b89bacb61'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Delete snapshot completed successfully. Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-693b772d-afb3-40a3-858d-dfc10b9d99fc-delete_snapshot" released by "delete_snapshot" :: held 2.570s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Snapshots deleted, issuing volume delete {{(pid=87313) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-quobyte-1a387bdf-e489-4f55-a4bb-331876c8eec6" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] Creating offline snapshot f461fb41-94b3-430e-b09e-7124ed914f18 of volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:18:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-1a387bdf-e489-4f55-a4bb-331876c8eec6" acquired by "delete_volume" :: waited 0.030s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb7b1e2-47ca-4795-a805-92b32b500b8f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5199c-b0c9-462c-9914-b7daf57a2466]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:03 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 Sep 07 02:18:03 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:03 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 Sep 07 02:18:03 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:03 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:03 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241" returned: 0 in 0.435s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6" returned: 0 in 0.435s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:03 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 1G Sep 07 02:18:03 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:03 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6 Sep 07 02:18:03 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:03 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a387bdf-e489-4f55-a4bb-331876c8eec6" returned: 0 in 0.352s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-1a387bdf-e489-4f55-a4bb-331876c8eec6" released by "delete_volume" :: held 0.861s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Created reservations ['bcf381be-a50d-4ed4-a581-d33857329733', '13812d69-2a80-4fb2-9274-331364bbe10a', '7e207339-8de3-41af-824e-cc6b7b4ed8e1', '1ba7778d-47b4-45a0-8e25-d0ecd0876325'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:04 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:18:04 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:04 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 1G" returned: 0 in 0.594s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:04 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:04 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:04 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.331s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:18:04 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Deleted volume successfully. Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9d6a0321-aff6-4a7d-86d2-0273dc9ffd8a tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-1a387bdf-e489-4f55-a4bb-331876c8eec6-delete_volume" released by "delete_volume" :: held 4.113s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:04 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.360s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:04 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 is being set with open permissions: ugo+rw Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:04 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:04 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:04 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.297s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:04 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.info Sep 07 02:18:04 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "cinder-quobyte-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:05 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.info" returned: 0 in 0.543s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:05 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.info is being set with open permissions: ugo+rw Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:05 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.info Sep 07 02:18:05 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" acquired by "delete_volume" :: waited 0.078s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4580611d-eee4-48e9-86b0-835f57fb740b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:05 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 Sep 07 02:18:05 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:05 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.info" returned: 0 in 0.368s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.846s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d12a46dc-ebe8-4f2f-8730-475ba545c583 tempest-SnapshotsActionsTest-692920182 None] Create snapshot completed successfully Sep 07 02:18:05 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" returned: 0 in 0.483s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:06 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1 Sep 07 02:18:06 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:06 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" returned: 0 in 0.303s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-quobyte-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1" released by "delete_volume" :: held 0.859s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:06 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Created reservations ['e5d8e85a-1b02-4293-8042-01f19f1cb9ec', 'cb6485d1-9a99-434b-ac50-b6fa61b56200', 'b15a6955-f29a-47c1-ab9f-64484fcb617c', '6aebc330-47f9-425c-b01a-efc2bfd54e27'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:06 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:18:06 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:06 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.489s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:06 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:18:06 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Deleted volume successfully. Sep 07 02:18:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] Creating offline snapshot eb63edba-8f09-4129-ace3-f9e13a3f2005 of volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:18:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03a357f7-b46b-4426-83c3-16d662fcd79c tempest-VolumesDeleteCascade-1954200033 None] Lock "cinder-656dee96-de6e-49c9-9c05-6fd5fdc6b8d1-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:07 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc24fa9-f966-4aad-8b9c-7c965ca1bfe1]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:07 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:07 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:07 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.632s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:07 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 1G Sep 07 02:18:07 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:08 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 1G" returned: 0 in 0.639s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:08 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 Sep 07 02:18:08 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-6f614b84-dc53-4d42-b26c-35d8b5b043a7 req-9b663a9b-f93d-4e97-8810-5f9014efa7e3 tempest-AttachVolumeShelveTestJSON-860885807 None] No connector for attachment 5a13b1ba-7471-4049-afae-18ba17eeebde; skipping storage backend terminate_connection call. {{(pid=87313) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 07 02:18:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-6f614b84-dc53-4d42-b26c-35d8b5b043a7 req-9b663a9b-f93d-4e97-8810-5f9014efa7e3 tempest-AttachVolumeShelveTestJSON-860885807 None] Deleting attachment 5a13b1ba-7471-4049-afae-18ba17eeebde. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:18:08 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005" returned: 0 in 0.379s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:08 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 is being set with open permissions: ugo+rw Sep 07 02:18:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:08 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 Sep 07 02:18:08 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:09 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005" returned: 0 in 0.302s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:09 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b3eeddc8-253c-4545-9f75-f501bf2c8709 tempest-SnapshotsActionsTest-692920182 None] Create snapshot completed successfully Sep 07 02:18:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-eb63edba-8f09-4129-ace3-f9e13a3f2005-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-eb63edba-8f09-4129-ace3-f9e13a3f2005-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-quobyte-eb63edba-8f09-4129-ace3-f9e13a3f2005" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-eb63edba-8f09-4129-ace3-f9e13a3f2005" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Deleting offline snapshot eb63edba-8f09-4129-ace3-f9e13a3f2005 of volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:18:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] snapshot_file for this snap is: volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:18:10 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb8110-1aa0-4558-9d9d-3ad4dec1a00d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:10 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 Sep 07 02:18:10 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:11 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005" returned: 0 in 0.589s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[618cb747-0c03-4fce-871b-2e4c2e1ef97a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:11 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:11 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:11 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.571s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:12 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 Sep 07 02:18:12 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:12 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005" returned: 0 in 0.661s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:12 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005 Sep 07 02:18:12 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:13 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.eb63edba-8f09-4129-ace3-f9e13a3f2005" returned: 0 in 0.535s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-eb63edba-8f09-4129-ace3-f9e13a3f2005" released by "_delete_snapshot" :: held 2.609s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" released by "delete_snapshot" :: held 2.677s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Flow 'volume_create_manager' (d1b22088-375c-4011-b912-205173b84c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94246a14-9d74-4bf0-92b6-0a0c4187a271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94246a14-9d74-4bf0-92b6-0a0c4187a271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1234895431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a686234a-8f5d-4c3c-8cdc-e0c27410215e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c300428b74ed45119edfccc2bee9d68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:13Z,use_quota=True,user_id='3ea0381b7d3b439698f70a243ad8d874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135c505f-bc7e-483c-ac55-7f9935304cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135c505f-bc7e-483c-ac55-7f9935304cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17df2480-77e3-44fb-b2a2-37dac6f7ae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17df2480-77e3-44fb-b2a2-37dac6f7ae9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a686234a-8f5d-4c3c-8cdc-e0c27410215e', 'volume_name': 'volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5144a055-ff03-4ee1-acaf-28c9af765931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5144a055-ff03-4ee1-acaf-28c9af765931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e4769a-2992-4736-b94e-a4a9fbf7f804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:13 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Volume a686234a-8f5d-4c3c-8cdc-e0c27410215e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e', 'volume_size': 1} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1234895431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a686234a-8f5d-4c3c-8cdc-e0c27410215e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c300428b74ed45119edfccc2bee9d68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:13Z,use_quota=True,user_id='3ea0381b7d3b439698f70a243ad8d874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Creating volume a686234a-8f5d-4c3c-8cdc-e0c27410215e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:18:13 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:13 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e 1073741824 Sep 07 02:18:13 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Created reservations ['795322f7-ec6d-4e6d-8196-998deffec1a4', 'd228ee5e-2fb1-48ca-83e8-24fd194b18f1', '4e6d24e7-c7ab-4774-90a2-103148490dae', 'c4fe0212-cabb-4542-860c-d39ce7736c77'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Delete snapshot completed successfully. Sep 07 02:18:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8f96e-3b9e-441e-85b1-ac012e3f7aa5 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-eb63edba-8f09-4129-ace3-f9e13a3f2005-delete_snapshot" released by "delete_snapshot" :: held 2.975s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:14 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e 1073741824" returned: 0 in 0.726s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:14 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e Sep 07 02:18:14 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:14 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e" returned: 0 in 0.415s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e4769a-2992-4736-b94e-a4a9fbf7f804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a696f2-a3b4-41e5-bcfa-b2bfbc282830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] Creating offline snapshot d3b0dece-4b79-4fdc-b669-24ca362857db of volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:18:14 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Volume volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e (a686234a-8f5d-4c3c-8cdc-e0c27410215e): created successfully Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a696f2-a3b4-41e5-bcfa-b2bfbc282830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Flow 'volume_create_manager' (d1b22088-375c-4011-b912-205173b84c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1de8e6-37fc-4c1b-8bc3-4df5f538617d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:14 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f40b9cb4-ed79-474e-a3de-bff23745e535 tempest-VolumesMetadataTest-2007443297 None] Created volume successfully. Sep 07 02:18:15 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:15 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:15 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.689s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:15 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db 1G Sep 07 02:18:15 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:16 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db 1G" returned: 0 in 0.902s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:16 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db Sep 07 02:18:16 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Acquiring lock "cinder-a686234a-8f5d-4c3c-8cdc-e0c27410215e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Lock "cinder-a686234a-8f5d-4c3c-8cdc-e0c27410215e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Acquiring lock "cinder-quobyte-a686234a-8f5d-4c3c-8cdc-e0c27410215e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Lock "cinder-quobyte-a686234a-8f5d-4c3c-8cdc-e0c27410215e" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:16 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbc46f7-c7de-4582-8cd0-e0f256be46f7]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:16 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db" returned: 0 in 0.534s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:16 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db is being set with open permissions: ugo+rw Sep 07 02:18:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:16 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db Sep 07 02:18:16 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:17 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e Sep 07 02:18:17 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:17 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db" returned: 0 in 0.424s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.774s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:17 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8f0286d6-d34f-4846-817b-c20ebd630260 tempest-SnapshotsActionsTest-692920182 None] Create snapshot completed successfully Sep 07 02:18:17 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e" returned: 0 in 0.762s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:17 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e Sep 07 02:18:17 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:18 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a686234a-8f5d-4c3c-8cdc-e0c27410215e" returned: 0 in 0.427s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Lock "cinder-quobyte-a686234a-8f5d-4c3c-8cdc-e0c27410215e" released by "delete_volume" :: held 1.247s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-d3b0dece-4b79-4fdc-b669-24ca362857db-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Created reservations ['8d570c1d-c356-4628-b576-015a53dd2df6', '116b5ece-94a8-4a2d-92a3-bd58064a9ab7', '12a7c6ba-8d2f-4f5d-b672-8576b0b25507', '2b641c72-abd4-430e-a262-316da54115a9'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-d3b0dece-4b79-4fdc-b669-24ca362857db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-quobyte-d3b0dece-4b79-4fdc-b669-24ca362857db" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-d3b0dece-4b79-4fdc-b669-24ca362857db" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Deleting offline snapshot d3b0dece-4b79-4fdc-b669-24ca362857db of volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] snapshot_file for this snap is: volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e6ec6a-a12d-46b5-8cb8-0f900e502d7b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:18 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:18:18 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:18 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db Sep 07 02:18:18 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:18 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.409s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:18:18 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:18 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Deleted volume successfully. Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db" returned: 0 in 0.509s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e7e671-b26d-49d2-8a25-6b90bab432b5]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b297ab68-75f2-42e3-bbde-f7eb0adbc794 tempest-VolumesMetadataTest-2007443297 None] Lock "cinder-a686234a-8f5d-4c3c-8cdc-e0c27410215e-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:19 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:19 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:19 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.527s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:19 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db Sep 07 02:18:19 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:19 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db" returned: 0 in 0.423s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:19 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db Sep 07 02:18:19 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:20 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.d3b0dece-4b79-4fdc-b669-24ca362857db" returned: 0 in 0.276s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-d3b0dece-4b79-4fdc-b669-24ca362857db" released by "_delete_snapshot" :: held 1.878s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" released by "delete_snapshot" :: held 1.914s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:20 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Created reservations ['6f8925d8-8967-4eee-bcc1-6c58af6b4de3', 'abb85ef6-a67e-48ef-9e34-ba8e60ffc161', '9afbf947-4be6-4a15-8eea-207399481201', 'f7bcd723-41c0-4d8d-8d6b-56fdd58c0e82'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:20 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Delete snapshot completed successfully. Sep 07 02:18:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-11f2a1d9-c383-4b24-8b9f-5148f22bd69b tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-d3b0dece-4b79-4fdc-b669-24ca362857db-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] Creating offline snapshot 11d544d8-e3f5-4071-a2a3-afda5830b0c5 of volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:18:22 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90761e2-cc0e-464c-85c7-6251b731f623]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:22 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:22 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:22 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.523s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:22 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 1G Sep 07 02:18:22 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:23 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 1G" returned: 0 in 0.800s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:23 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 Sep 07 02:18:23 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:24 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5" returned: 0 in 0.702s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:24 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 is being set with open permissions: ugo+rw Sep 07 02:18:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:24 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 Sep 07 02:18:24 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:24 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5" returned: 0 in 0.652s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:24 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=110,cinder:UPDATE=101,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:18:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:24 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-54508d43-099d-4ec8-979d-dbf55915e0cb tempest-SnapshotsActionsTest-692920182 None] Create snapshot completed successfully Sep 07 02:18:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-11d544d8-e3f5-4071-a2a3-afda5830b0c5-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-11d544d8-e3f5-4071-a2a3-afda5830b0c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-quobyte-11d544d8-e3f5-4071-a2a3-afda5830b0c5" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-11d544d8-e3f5-4071-a2a3-afda5830b0c5" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Deleting offline snapshot 11d544d8-e3f5-4071-a2a3-afda5830b0c5 of volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:18:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] snapshot_file for this snap is: volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:18:25 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6bac1b-2587-43ae-92d4-a8f6d34303ee]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:25 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 Sep 07 02:18:25 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:26 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5" returned: 0 in 0.475s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[634281e1-d474-4edd-bc3e-144d97f3777e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:26 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:18:26 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:26 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:26 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:26 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.430s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 8 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:18:26 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.675s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:26 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 Sep 07 02:18:26 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Flow 'volume_create_manager' (43db52bc-803f-4122-a3c1-b1ec079bd079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f13f08-2efe-4053-ba9e-084aa543d404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f13f08-2efe-4053-ba9e-084aa543d404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1203504558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488a1738-c360-4770-a75b-c7593124f9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111c606411a44c1182ab8f9fd81c090b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:27Z,use_quota=True,user_id='ff7b43eb7c6345aba055f0cdada6875d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef65921e-8ac0-4d05-914f-5fd4cf8d7b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef65921e-8ac0-4d05-914f-5fd4cf8d7b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0345b4e0-81d9-4bb0-9d1c-479d4cb1ec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0345b4e0-81d9-4bb0-9d1c-479d4cb1ec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488a1738-c360-4770-a75b-c7593124f9ce', 'volume_name': 'volume-488a1738-c360-4770-a75b-c7593124f9ce', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f65adf-7bb0-4fe6-9ca0-82c5523f6653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f65adf-7bb0-4fe6-9ca0-82c5523f6653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e5b836-b53d-4383-a061-ae83e1b95e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:27 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Volume 488a1738-c360-4770-a75b-c7593124f9ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488a1738-c360-4770-a75b-c7593124f9ce', 'volume_size': 1} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1203504558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488a1738-c360-4770-a75b-c7593124f9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111c606411a44c1182ab8f9fd81c090b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:27Z,use_quota=True,user_id='ff7b43eb7c6345aba055f0cdada6875d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Creating volume 488a1738-c360-4770-a75b-c7593124f9ce {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:18:27 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:27 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce 1073741824 Sep 07 02:18:27 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:27 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5" returned: 0 in 0.434s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:27 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5 Sep 07 02:18:27 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:27 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.11d544d8-e3f5-4071-a2a3-afda5830b0c5" returned: 0 in 0.263s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:27 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce 1073741824" returned: 0 in 0.466s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-11d544d8-e3f5-4071-a2a3-afda5830b0c5" released by "_delete_snapshot" :: held 2.047s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" released by "delete_snapshot" :: held 2.096s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:27 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce Sep 07 02:18:27 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Created reservations ['7fedc63e-05dc-48f7-b476-a22e5af18bf3', '79e5da40-6c3e-4988-bed6-b03f3448c1a8', 'e71aae1e-b9e8-44ec-8e8e-cb123bc6d67d', 'bbefe73e-d16e-473f-b80c-d57e1ddfa7ba'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Delete snapshot completed successfully. Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b04738b4-cd83-40c5-b590-17125c8f1ef4 tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-11d544d8-e3f5-4071-a2a3-afda5830b0c5-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:27 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce" returned: 0 in 0.268s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e5b836-b53d-4383-a061-ae83e1b95e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488a1738-c360-4770-a75b-c7593124f9ce', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b23776-41a6-4d13-b7b4-9a6d19ecb204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:27 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Volume volume-488a1738-c360-4770-a75b-c7593124f9ce (488a1738-c360-4770-a75b-c7593124f9ce): created successfully Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b23776-41a6-4d13-b7b4-9a6d19ecb204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Flow 'volume_create_manager' (43db52bc-803f-4122-a3c1-b1ec079bd079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:28 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9bdabd07-c44c-4cc5-9f6a-62a9928f44d3 tempest-VolumesTransfersV355Test-1485241246 None] Created volume successfully. Sep 07 02:18:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] Creating offline snapshot 8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 of volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:18:29 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af1a8e-fcb4-4c1e-a915-8e9921a286af]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:29 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:29 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:29 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.412s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:29 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 1G Sep 07 02:18:29 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:29 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e4d27324-24ec-43d7-9f51-964f00ee34b1 tempest-VolumesTransfersV355Test-643005094 None] Transfer volume completed successfully. Sep 07 02:18:29 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 1G" returned: 0 in 0.487s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:30 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 Sep 07 02:18:30 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:30 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0" returned: 0 in 0.321s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:30 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 is being set with open permissions: ugo+rw Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:30 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 Sep 07 02:18:30 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:30 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0" returned: 0 in 0.290s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Acquiring lock "cinder-488a1738-c360-4770-a75b-c7593124f9ce-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.662s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Lock "cinder-488a1738-c360-4770-a75b-c7593124f9ce-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:30 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-724c8a68-2fcc-4410-952d-2030b0287d43 tempest-SnapshotsActionsTest-692920182 None] Create snapshot completed successfully Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Acquiring lock "cinder-quobyte-488a1738-c360-4770-a75b-c7593124f9ce" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Lock "cinder-quobyte-488a1738-c360-4770-a75b-c7593124f9ce" acquired by "delete_volume" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ac9141-1aed-484c-88ed-8aa91a670d22]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:30 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce Sep 07 02:18:30 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:31 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-8d5ad905-48e2-4bac-81b0-c46ba7faf2a0-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce" returned: 0 in 0.462s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-8d5ad905-48e2-4bac-81b0-c46ba7faf2a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:31 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce Sep 07 02:18:31 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Acquiring lock "cinder-quobyte-8d5ad905-48e2-4bac-81b0-c46ba7faf2a0" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-8d5ad905-48e2-4bac-81b0-c46ba7faf2a0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Deleting offline snapshot 8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 of volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] snapshot_file for this snap is: volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[605c893a-9a74-45d0-93aa-6b49da99acb8]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:31 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 Sep 07 02:18:31 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:31 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-488a1738-c360-4770-a75b-c7593124f9ce" returned: 0 in 0.307s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Lock "cinder-quobyte-488a1738-c360-4770-a75b-c7593124f9ce" released by "delete_volume" :: held 0.827s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Created reservations ['3ae66481-284c-4362-9c45-71d36d4c895f', '6202d0bb-47a3-4864-8c33-91363df97613', 'e1704b60-16c5-4b8f-aae8-3830723fb14f', '5368ed8a-6d95-43bf-98d2-4d4a103a0c9c'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:31 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0" returned: 0 in 0.404s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:31 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:18:31 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccb4e54-79b2-4bd0-8c02-a679c8fa569c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:32 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:32 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:32 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.295s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:18:32 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Deleted volume successfully. Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-964fd256-6f63-43df-aee7-b32e485abb5e tempest-VolumesTransfersV355Test-180436298 None] Lock "cinder-488a1738-c360-4770-a75b-c7593124f9ce-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:32 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.542s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:32 devstack sudo[91778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 Sep 07 02:18:32 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Flow 'volume_create_manager' (e8034b27-4af8-4de7-8d0d-efebf899fd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c3ad4f-0461-4d3d-b6dc-125882d3f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c3ad4f-0461-4d3d-b6dc-125882d3f774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1278555465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ce1f5f-49ad-492e-8779-8d4f4bc9d160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111c606411a44c1182ab8f9fd81c090b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:33Z,use_quota=True,user_id='ff7b43eb7c6345aba055f0cdada6875d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6b0453-4124-447f-9349-7f21215f4075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6b0453-4124-447f-9349-7f21215f4075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ebd80f-085e-4365-bb0c-f9b15b8c58d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ebd80f-085e-4365-bb0c-f9b15b8c58d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ce1f5f-49ad-492e-8779-8d4f4bc9d160', 'volume_name': 'volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db815953-2022-40fb-a6d5-4a34becc1c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db815953-2022-40fb-a6d5-4a34becc1c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df432a3-bf97-45b9-a853-b44481dfa19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:32 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Volume a7ce1f5f-49ad-492e-8779-8d4f4bc9d160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160', 'volume_size': 1} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1278555465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ce1f5f-49ad-492e-8779-8d4f4bc9d160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111c606411a44c1182ab8f9fd81c090b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:33Z,use_quota=True,user_id='ff7b43eb7c6345aba055f0cdada6875d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Creating volume a7ce1f5f-49ad-492e-8779-8d4f4bc9d160 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:18:32 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:32 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160 1073741824 Sep 07 02:18:32 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:32 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0" returned: 0 in 0.524s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:33 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0 Sep 07 02:18:33 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:33 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:33 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.8d5ad905-48e2-4bac-81b0-c46ba7faf2a0" returned: 0 in 0.291s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160 1073741824" returned: 0 in 0.480s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-8d5ad905-48e2-4bac-81b0-c46ba7faf2a0" released by "_delete_snapshot" :: held 1.885s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" released by "delete_snapshot" :: held 1.924s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:33 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160 Sep 07 02:18:33 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Created reservations ['03d36930-1964-4995-b2d8-e9c2ae77c34e', 'c6d4d660-08ab-4b72-882e-d767f71d611f', 'a7ee5e0a-f7c9-425a-adb4-adac93a59264', '24645b9f-558b-448a-9db9-0932fab3fdf7'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:33 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Delete snapshot completed successfully. Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9ea54249-b6ec-478d-856b-e4f8eb3e7bdf tempest-SnapshotsActionsTest-5265240 None] Lock "cinder-8d5ad905-48e2-4bac-81b0-c46ba7faf2a0-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:33 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160" returned: 0 in 0.325s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df432a3-bf97-45b9-a853-b44481dfa19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620c8c5d-16c1-4869-871c-90edd3e53825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:33 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Volume volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160 (a7ce1f5f-49ad-492e-8779-8d4f4bc9d160): created successfully Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620c8c5d-16c1-4869-871c-90edd3e53825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Flow 'volume_create_manager' (e8034b27-4af8-4de7-8d0d-efebf899fd0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:33 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d8e8293b-7298-4e4b-8081-1ed5d7d6853d tempest-VolumesTransfersV355Test-1485241246 None] Created volume successfully. Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "cinder-f461fb41-94b3-430e-b09e-7124ed914f18-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Lock "cinder-f461fb41-94b3-430e-b09e-7124ed914f18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "cinder-quobyte-f461fb41-94b3-430e-b09e-7124ed914f18" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Lock "cinder-quobyte-f461fb41-94b3-430e-b09e-7124ed914f18" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Deleting offline snapshot f461fb41-94b3-430e-b09e-7124ed914f18 of volume 78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] snapshot_file for this snap is: volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a199182b-8fa8-4b08-8461-34d916c83f8f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:34 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:34 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:34 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.373s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f02196-cdef-45dc-b643-e12bc38fe3dd]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:34 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 Sep 07 02:18:34 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:34 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241" returned: 0 in 0.381s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:34 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:34 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Acquiring lock "cinder-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Lock "cinder-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Acquiring lock "cinder-quobyte-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Lock "cinder-quobyte-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eadabf6-3008-4d42-a2e8-53e799c69c35]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:35 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.434s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:35 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18 Sep 07 02:18:35 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:35 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160 Sep 07 02:18:35 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:35 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241.f461fb41-94b3-430e-b09e-7124ed914f18" returned: 0 in 0.321s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:35 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160" returned: 0 in 0.417s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:35 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160 Sep 07 02:18:35 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Lock "cinder-quobyte-f461fb41-94b3-430e-b09e-7124ed914f18" released by "_delete_snapshot" :: held 1.643s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" released by "delete_snapshot" :: held 1.665s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Created reservations ['7ccf9eac-0f59-449c-beb2-c19136ab901b', '99e0e3e4-0cfb-47b1-8e49-f6a337df134d', 'e2ab608d-6c35-4607-8ee2-fc1ca1718195', 'f64316e2-431f-4f48-97a7-9701639bd497'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:35 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Delete snapshot completed successfully. Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-618eaad0-a4fc-49bb-a735-cd968214f215 tempest-SnapshotsActionsTest-692920182 None] Lock "cinder-f461fb41-94b3-430e-b09e-7124ed914f18-delete_snapshot" released by "delete_snapshot" :: held 1.851s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:35 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160" returned: 0 in 0.311s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Lock "cinder-quobyte-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160" released by "delete_volume" :: held 0.777s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Created reservations ['a1b94fa6-ae22-42af-b01c-8bc84e5019a7', 'dac744d8-aa9b-414c-bff0-228db0fe02d7', 'e6f41f4d-3612-4b0c-8c7a-d00bab74d02c', 'ce1a40b9-39e3-4cf4-a876-c6fd080da91d'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:36 devstack sudo[91826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:18:36 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "cinder-78d9f32c-e941-42a5-8bc8-7936ed3bc241-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Lock "cinder-78d9f32c-e941-42a5-8bc8-7936ed3bc241-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" acquired by "delete_volume" :: waited 0.048s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd8f6f7-f260-4b3a-96f0-572ef55f605c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:36 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.622s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:18:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Deleted volume successfully. Sep 07 02:18:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d06e6b3c-38b2-4a30-b293-03b7d6b038f7 tempest-VolumesTransfersV355Test-180436298 None] Lock "cinder-a7ce1f5f-49ad-492e-8779-8d4f4bc9d160-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:36 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 Sep 07 02:18:36 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:37 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241" returned: 0 in 0.607s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:37 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241 Sep 07 02:18:37 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-6ac4d7e1-3e75-40fa-833b-2ef9bba36d06 req-9e60498f-db8a-4ffd-a39d-5cfb16a9efbe tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-6ac4d7e1-3e75-40fa-833b-2ef9bba36d06 req-9e60498f-db8a-4ffd-a39d-5cfb16a9efbe tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-6ac4d7e1-3e75-40fa-833b-2ef9bba36d06 req-9e60498f-db8a-4ffd-a39d-5cfb16a9efbe tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:37 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78d9f32c-e941-42a5-8bc8-7936ed3bc241" returned: 0 in 0.365s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-6ac4d7e1-3e75-40fa-833b-2ef9bba36d06 req-9e60498f-db8a-4ffd-a39d-5cfb16a9efbe tempest-ServerActionsTestOtherA-678111813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-bcbb4357-67bd-45a8-8a73-626a6e53897f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b815317-9916-44ae-bd97-b46a40acd924', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Lock "cinder-quobyte-78d9f32c-e941-42a5-8bc8-7936ed3bc241" released by "delete_volume" :: held 1.067s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:37 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-6ac4d7e1-3e75-40fa-833b-2ef9bba36d06 req-9e60498f-db8a-4ffd-a39d-5cfb16a9efbe tempest-ServerActionsTestOtherA-678111813 None] attachment_update completed successfully. Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Created reservations ['43c6bf11-6777-4298-9cc6-62c956c35c7a', 'c8035a9d-68cd-4134-a0d0-c69254237808', '6436af80-5c59-41ed-99df-3f312bdca8b2', '941910e7-e66f-40d3-ad13-dd5c77f7accf'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:37 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:18:37 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:38 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.354s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:38 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:18:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Deleted volume successfully. Sep 07 02:18:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0a3a998e-0335-4f21-afaf-aa189cbbddcd tempest-SnapshotsActionsTest-692920182 None] Lock "cinder-78d9f32c-e941-42a5-8bc8-7936ed3bc241-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:41 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-b394230a-7eb7-43aa-9b0b-634928be2ffb req-299167f9-ebe5-45a9-bc2c-da144ef87a00 tempest-ServerActionsTestOtherA-678111813 None] Terminate volume connection completed successfully. Sep 07 02:18:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-b394230a-7eb7-43aa-9b0b-634928be2ffb req-299167f9-ebe5-45a9-bc2c-da144ef87a00 tempest-ServerActionsTestOtherA-678111813 None] Deleting attachment 4b815317-9916-44ae-bd97-b46a40acd924. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:18:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-b394230a-7eb7-43aa-9b0b-634928be2ffb req-dfa93edc-9e9c-4fbb-b03e-5ad1f8587fb5 tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-b394230a-7eb7-43aa-9b0b-634928be2ffb req-dfa93edc-9e9c-4fbb-b03e-5ad1f8587fb5 tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-b394230a-7eb7-43aa-9b0b-634928be2ffb req-dfa93edc-9e9c-4fbb-b03e-5ad1f8587fb5 tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-b394230a-7eb7-43aa-9b0b-634928be2ffb req-dfa93edc-9e9c-4fbb-b03e-5ad1f8587fb5 tempest-ServerActionsTestOtherA-678111813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-bcbb4357-67bd-45a8-8a73-626a6e53897f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3618a317-eee2-4d81-b45b-e5f28759d3c8', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:18:42 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-b394230a-7eb7-43aa-9b0b-634928be2ffb req-dfa93edc-9e9c-4fbb-b03e-5ad1f8587fb5 tempest-ServerActionsTestOtherA-678111813 None] attachment_update completed successfully. Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Flow 'volume_create_manager' (01f71f6d-af5f-4c1e-afd9-ca705d5bb45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a82d61-ad4c-405b-9dc5-9a6335fc4238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a82d61-ad4c-405b-9dc5-9a6335fc4238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1671678969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c617bc4-b275-4ab9-97ba-aa6784b51438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b2e1571c3f431184730dfe8e58a23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:46Z,use_quota=True,user_id='e4f786d5b96c4f77a364aaa674e28afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06637794-7d53-4b33-a4a2-021e8aad6e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06637794-7d53-4b33-a4a2-021e8aad6e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6045908f-7649-46ab-90f2-952fdccfe98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6045908f-7649-46ab-90f2-952fdccfe98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c617bc4-b275-4ab9-97ba-aa6784b51438', 'volume_name': 'volume-9c617bc4-b275-4ab9-97ba-aa6784b51438', 'volume_size': 2}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f721f640-2bda-4bb1-98b6-7a465093a16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f721f640-2bda-4bb1-98b6-7a465093a16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe05353-5043-4db5-a6e3-22ed87d10b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:45 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Volume 9c617bc4-b275-4ab9-97ba-aa6784b51438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c617bc4-b275-4ab9-97ba-aa6784b51438', 'volume_size': 2} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1671678969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c617bc4-b275-4ab9-97ba-aa6784b51438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b2e1571c3f431184730dfe8e58a23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:46Z,use_quota=True,user_id='e4f786d5b96c4f77a364aaa674e28afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Creating volume 9c617bc4-b275-4ab9-97ba-aa6784b51438 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:18:45 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:18:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438 2147483648 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:45 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438 2147483648 Sep 07 02:18:45 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:46 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438 2147483648" returned: 0 in 0.689s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:46 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438 Sep 07 02:18:46 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:47 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438" returned: 0 in 0.474s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:18:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe05353-5043-4db5-a6e3-22ed87d10b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c617bc4-b275-4ab9-97ba-aa6784b51438', 'volume_size': 2}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8addcd-354c-4534-afa9-8cb67110a0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:47 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Volume volume-9c617bc4-b275-4ab9-97ba-aa6784b51438 (9c617bc4-b275-4ab9-97ba-aa6784b51438): created successfully Sep 07 02:18:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8addcd-354c-4534-afa9-8cb67110a0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Flow 'volume_create_manager' (01f71f6d-af5f-4c1e-afd9-ca705d5bb45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:47 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2fb8e6ce-1e01-4782-8f11-3eafb7ab67df tempest-VolumesCloneNegativeTest-188892251 None] Created volume successfully. Sep 07 02:18:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Acquiring lock "cinder-9c617bc4-b275-4ab9-97ba-aa6784b51438-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Lock "cinder-9c617bc4-b275-4ab9-97ba-aa6784b51438-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Acquiring lock "cinder-quobyte-9c617bc4-b275-4ab9-97ba-aa6784b51438" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Lock "cinder-quobyte-9c617bc4-b275-4ab9-97ba-aa6784b51438" acquired by "delete_volume" :: waited 0.036s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:48 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[049e6e90-0b3a-4cd1-b524-84b85acd392d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:48 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438 Sep 07 02:18:48 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:49 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438" returned: 0 in 0.595s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:49 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438 Sep 07 02:18:49 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:49 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9c617bc4-b275-4ab9-97ba-aa6784b51438" returned: 0 in 0.287s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Lock "cinder-quobyte-9c617bc4-b275-4ab9-97ba-aa6784b51438" released by "delete_volume" :: held 0.966s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:49 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Created reservations ['a15c9d78-6ae1-4267-a54d-2f13d4c8c3b3', '821b24e2-6a9c-45c5-bc0f-9a2cb8474336', '92927f82-9953-4e04-b7ae-0f9288261fc5', '7207984a-e362-4e8f-a6d9-b20fa8c6625e'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:49 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:18:49 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:50 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.279s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:50 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:18:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Deleted volume successfully. Sep 07 02:18:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2005c52e-9bd9-4c41-bb6d-188c9af7f612 tempest-VolumesCloneNegativeTest-188892251 None] Lock "cinder-9c617bc4-b275-4ab9-97ba-aa6784b51438-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Acquiring lock "cinder-41c1f8fc-a43d-4c87-a70e-f844f11cb018-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Lock "cinder-41c1f8fc-a43d-4c87-a70e-f844f11cb018-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Acquiring lock "cinder-quobyte-41c1f8fc-a43d-4c87-a70e-f844f11cb018" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:18:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Lock "cinder-quobyte-41c1f8fc-a43d-4c87-a70e-f844f11cb018" acquired by "delete_volume" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:18:53 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6a17a4-5759-451a-a2f1-ce2f767fb893]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:18:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:53 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018 Sep 07 02:18:53 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:53 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018" returned: 0 in 0.458s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:53 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018 Sep 07 02:18:53 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:54 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-41c1f8fc-a43d-4c87-a70e-f844f11cb018" returned: 0 in 0.282s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Lock "cinder-quobyte-41c1f8fc-a43d-4c87-a70e-f844f11cb018" released by "delete_volume" :: held 0.796s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Created reservations ['7259b6e1-a338-413b-a8ed-dde4e1797453', '34c9712d-c172-4f34-a68a-72999684f0bd', '5b419158-fb37-47c1-a55e-a8d0cc7c84ae', 'a89807a9-50eb-43d6-8cf8-14f0a56ed8f5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:54 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:18:54 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:54 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.388s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:18:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Deleted volume successfully. Sep 07 02:18:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d7f441f-d3d0-4d0e-881d-e75717d35d59 tempest-AttachVolumeShelveTestJSON-860885807 None] Lock "cinder-41c1f8fc-a43d-4c87-a70e-f844f11cb018-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Flow 'volume_create_manager' (b9863d2c-496f-4ef7-8d89-5dff0ccb41cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b6b62f-c2bf-4f8f-9111-a0fb4c850665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b6b62f-c2bf-4f8f-9111-a0fb4c850665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-796957941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85123658-2bfa-44de-bbc3-8583b2e3fcf1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d14d85e1cb9d49c4965b480bbe74d58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:56Z,use_quota=True,user_id='761d9f8891194db98ff1061a42dd1fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e28274-3ace-4a62-800f-5918b9e1b7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e28274-3ace-4a62-800f-5918b9e1b7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40afd198-d513-4d50-96f6-c3dfb71b6455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40afd198-d513-4d50-96f6-c3dfb71b6455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85123658-2bfa-44de-bbc3-8583b2e3fcf1', 'volume_name': 'volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2722a7-9cdc-4b19-8735-9e9b7bfa9b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2722a7-9cdc-4b19-8735-9e9b7bfa9b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4e7399-1e31-4941-aed7-14fd01ee1c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:56 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Volume 85123658-2bfa-44de-bbc3-8583b2e3fcf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1', 'volume_size': 1} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-796957941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85123658-2bfa-44de-bbc3-8583b2e3fcf1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d14d85e1cb9d49c4965b480bbe74d58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:56Z,use_quota=True,user_id='761d9f8891194db98ff1061a42dd1fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Creating volume 85123658-2bfa-44de-bbc3-8583b2e3fcf1 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:18:56 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:18:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:56 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1 1073741824 Sep 07 02:18:56 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:57 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1 1073741824" returned: 0 in 0.716s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:57 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1 Sep 07 02:18:57 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:18:57 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Sep 07 02:18:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1" returned: 0 in 0.317s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:18:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:18:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4e7399-1e31-4941-aed7-14fd01ee1c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7accf0-603c-453f-b6a2-eff991cc2c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:57 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Volume volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1 (85123658-2bfa-44de-bbc3-8583b2e3fcf1): created successfully Sep 07 02:18:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7accf0-603c-453f-b6a2-eff991cc2c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Flow 'volume_create_manager' (b9863d2c-496f-4ef7-8d89-5dff0ccb41cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d4249ff4-fe8b-45bd-8045-89d82f1d7d2e tempest-VolumesListTestJSON-1398198946 None] Created volume successfully. Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Flow 'volume_create_manager' (465f6b86-a30e-4d53-8031-8c2cc92356fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db9d05f-7420-4f92-8aaf-4b8c552d333f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=132,cinder:DELETE=11,cinder:SELECT=107,cinder:INSERT=33 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db9d05f-7420-4f92-8aaf-4b8c552d333f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1211501849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44de2c19-1cfa-4b64-b10d-a798cfc445bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d14d85e1cb9d49c4965b480bbe74d58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:59Z,use_quota=True,user_id='761d9f8891194db98ff1061a42dd1fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7928c1bb-2291-4d46-a2f5-a5ed75a49350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7928c1bb-2291-4d46-a2f5-a5ed75a49350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e24bdbf-4554-4175-945d-05b22b6c29fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e24bdbf-4554-4175-945d-05b22b6c29fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44de2c19-1cfa-4b64-b10d-a798cfc445bf', 'volume_name': 'volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9524790b-ba07-44ca-b5af-8ecd584a7c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9524790b-ba07-44ca-b5af-8ecd584a7c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b46496-af23-4ef6-bebe-a9ddfe24d0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:18:59 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Volume 44de2c19-1cfa-4b64-b10d-a798cfc445bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf', 'volume_size': 1} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1211501849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44de2c19-1cfa-4b64-b10d-a798cfc445bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d14d85e1cb9d49c4965b480bbe74d58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:18:59Z,use_quota=True,user_id='761d9f8891194db98ff1061a42dd1fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Creating volume 44de2c19-1cfa-4b64-b10d-a798cfc445bf {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:18:59 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:18:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:18:59 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf 1073741824 Sep 07 02:18:59 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:00 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf 1073741824" returned: 0 in 0.582s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:00 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf Sep 07 02:19:00 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:00 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf" returned: 0 in 0.304s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:19:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b46496-af23-4ef6-bebe-a9ddfe24d0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6610d7-a7ca-4c1b-a2d9-e86594ebd098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:00 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Volume volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf (44de2c19-1cfa-4b64-b10d-a798cfc445bf): created successfully Sep 07 02:19:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6610d7-a7ca-4c1b-a2d9-e86594ebd098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Flow 'volume_create_manager' (465f6b86-a30e-4d53-8031-8c2cc92356fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:00 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f3bcff55-53b1-43c9-afa2-302b75a48c02 tempest-VolumesListTestJSON-1398198946 None] Created volume successfully. Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Flow 'volume_create_manager' (b1eb4666-104a-42f7-afde-bfe89e85567f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8851946d-b976-4615-bc30-bf0de63ed548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8851946d-b976-4615-bc30-bf0de63ed548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1589871694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f925877c-a4fe-4a48-968e-db9a33f59c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d541a94fa64714b6609b4d9b6a544b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:01Z,use_quota=True,user_id='6d55cc2ffa684a36ba17b0763419f754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f46a69-ca67-4fd9-81de-59d5ec9624e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f46a69-ca67-4fd9-81de-59d5ec9624e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efced835-8f94-49a5-90bc-29ad96c15022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efced835-8f94-49a5-90bc-29ad96c15022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f925877c-a4fe-4a48-968e-db9a33f59c82', 'volume_name': 'volume-f925877c-a4fe-4a48-968e-db9a33f59c82', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82da69d9-4184-4fe4-97e3-2c1b2a4d227a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82da69d9-4184-4fe4-97e3-2c1b2a4d227a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04e556c-6021-429b-9414-e42056e2e0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:01 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Volume f925877c-a4fe-4a48-968e-db9a33f59c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f925877c-a4fe-4a48-968e-db9a33f59c82', 'volume_size': 1} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1589871694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f925877c-a4fe-4a48-968e-db9a33f59c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d541a94fa64714b6609b4d9b6a544b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:01Z,use_quota=True,user_id='6d55cc2ffa684a36ba17b0763419f754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Creating volume f925877c-a4fe-4a48-968e-db9a33f59c82 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:19:01 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:01 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82 1073741824 Sep 07 02:19:01 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:01 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82 1073741824" returned: 0 in 0.551s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:02 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82 Sep 07 02:19:02 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Flow 'volume_create_manager' (19d5872d-17d5-4d3c-a3cf-8508d90938f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5d0e25-1397-4a22-ba87-8caaf7c41e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5d0e25-1397-4a22-ba87-8caaf7c41e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-209496733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29517722-4ff1-4545-abee-5c8cef3ab2c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d14d85e1cb9d49c4965b480bbe74d58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:02Z,use_quota=True,user_id='761d9f8891194db98ff1061a42dd1fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24cddc9-5521-4013-a0c2-2e0a517e6cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24cddc9-5521-4013-a0c2-2e0a517e6cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db3a580-694e-42ed-a470-5adf174134f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db3a580-694e-42ed-a470-5adf174134f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29517722-4ff1-4545-abee-5c8cef3ab2c3', 'volume_name': 'volume-29517722-4ff1-4545-abee-5c8cef3ab2c3', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479c4af7-7064-478d-834e-071d124d3c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479c4af7-7064-478d-834e-071d124d3c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f7d53b-2bd1-437a-89b9-fcc783404e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:02 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:02 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Volume 29517722-4ff1-4545-abee-5c8cef3ab2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29517722-4ff1-4545-abee-5c8cef3ab2c3', 'volume_size': 1} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82" returned: 0 in 0.343s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-209496733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29517722-4ff1-4545-abee-5c8cef3ab2c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d14d85e1cb9d49c4965b480bbe74d58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:02Z,use_quota=True,user_id='761d9f8891194db98ff1061a42dd1fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Creating volume 29517722-4ff1-4545-abee-5c8cef3ab2c3 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:19:02 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04e556c-6021-429b-9414-e42056e2e0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f925877c-a4fe-4a48-968e-db9a33f59c82', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:02 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3 1073741824 Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f940ed34-07b4-4864-9a4b-659340160c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:02 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:02 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Volume volume-f925877c-a4fe-4a48-968e-db9a33f59c82 (f925877c-a4fe-4a48-968e-db9a33f59c82): created successfully Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f940ed34-07b4-4864-9a4b-659340160c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Flow 'volume_create_manager' (b1eb4666-104a-42f7-afde-bfe89e85567f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-432884c9-db75-4883-87d3-2293e43b123a tempest-VolumesServicesTestJSON-1340948667 None] Created volume successfully. Sep 07 02:19:02 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3 1073741824" returned: 0 in 0.448s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:02 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3 Sep 07 02:19:02 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:03 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3" returned: 0 in 0.265s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f7d53b-2bd1-437a-89b9-fcc783404e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29517722-4ff1-4545-abee-5c8cef3ab2c3', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae65abad-55d5-4074-be96-737ccfe8e5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:03 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Volume volume-29517722-4ff1-4545-abee-5c8cef3ab2c3 (29517722-4ff1-4545-abee-5c8cef3ab2c3): created successfully Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae65abad-55d5-4074-be96-737ccfe8e5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Flow 'volume_create_manager' (19d5872d-17d5-4d3c-a3cf-8508d90938f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:03 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-497d2dae-08cd-4410-9499-dc900b7fcb7b tempest-VolumesListTestJSON-1398198946 None] Created volume successfully. Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Acquiring lock "cinder-f925877c-a4fe-4a48-968e-db9a33f59c82-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Lock "cinder-f925877c-a4fe-4a48-968e-db9a33f59c82-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Acquiring lock "cinder-quobyte-f925877c-a4fe-4a48-968e-db9a33f59c82" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Lock "cinder-quobyte-f925877c-a4fe-4a48-968e-db9a33f59c82" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[2289e011-0e06-4af0-8378-338db8e10cbf]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:03 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82 Sep 07 02:19:03 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:04 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82" returned: 0 in 0.362s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:04 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82 Sep 07 02:19:04 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:04 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f925877c-a4fe-4a48-968e-db9a33f59c82" returned: 0 in 0.297s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Lock "cinder-quobyte-f925877c-a4fe-4a48-968e-db9a33f59c82" released by "delete_volume" :: held 0.709s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Created reservations ['ebe0cc8e-edcc-40a8-904b-f6fd273bb6ef', 'ceb72cc0-c7d5-4313-8105-c5f4a152fb6a', '09f76f40-f84b-4f7e-b3ca-1e2f945e7cba', '4da8176e-ccd8-4272-b353-4b830ff430f5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:04 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:19:04 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:04 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.294s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:19:04 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Deleted volume successfully. Sep 07 02:19:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c34e0462-b09d-4f79-bebb-38a0fa4b41fb tempest-VolumesServicesTestJSON-1340948667 None] Lock "cinder-f925877c-a4fe-4a48-968e-db9a33f59c82-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:19:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "cinder-29517722-4ff1-4545-abee-5c8cef3ab2c3-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-29517722-4ff1-4545-abee-5c8cef3ab2c3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "cinder-quobyte-29517722-4ff1-4545-abee-5c8cef3ab2c3" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-quobyte-29517722-4ff1-4545-abee-5c8cef3ab2c3" acquired by "delete_volume" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:06 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[5057fb59-c106-4e33-9626-52a34540a760]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:06 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3 Sep 07 02:19:06 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:07 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3" returned: 0 in 0.543s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:07 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3 Sep 07 02:19:07 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:07 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-29517722-4ff1-4545-abee-5c8cef3ab2c3" returned: 0 in 0.379s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-quobyte-29517722-4ff1-4545-abee-5c8cef3ab2c3" released by "delete_volume" :: held 0.983s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:19:07 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Created reservations ['569819fe-452c-41ed-a70a-75f25c2dce00', 'a59556b7-b2ff-42e2-969c-1039060be21a', '79865c1e-1a0c-4a24-aae0-08f0ef009949', '2454b5db-c8f9-4a98-8b0e-96536833dd95'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:19:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:08 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:19:08 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:08 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.457s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:08 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:19:08 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Deleted volume successfully. Sep 07 02:19:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-36680c76-4661-4211-8abe-060c3b10096d tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-29517722-4ff1-4545-abee-5c8cef3ab2c3-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:19:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "cinder-44de2c19-1cfa-4b64-b10d-a798cfc445bf-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-44de2c19-1cfa-4b64-b10d-a798cfc445bf-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "cinder-quobyte-44de2c19-1cfa-4b64-b10d-a798cfc445bf" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-quobyte-44de2c19-1cfa-4b64-b10d-a798cfc445bf" acquired by "delete_volume" :: waited 0.043s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:09 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[281af7f5-6b0e-4929-9033-5b371ba8f9c1]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:09 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf Sep 07 02:19:09 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:09 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf" returned: 0 in 0.451s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:09 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf Sep 07 02:19:09 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:10 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-44de2c19-1cfa-4b64-b10d-a798cfc445bf" returned: 0 in 0.318s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-quobyte-44de2c19-1cfa-4b64-b10d-a798cfc445bf" released by "delete_volume" :: held 0.838s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Created reservations ['2563bc2c-aead-4acd-840e-7b0f65051f9d', '4fb15219-7006-49e1-809d-e6e4fab7e7ca', '8a15c41c-10e6-499e-919e-12a29d62ed46', '866e8de5-30cc-4b97-b6f5-04d6a15edbcc'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:10 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:19:10 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:10 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.332s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:19:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Deleted volume successfully. Sep 07 02:19:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-be16cfcb-a228-42d3-817e-bee3c2ccc239 tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-44de2c19-1cfa-4b64-b10d-a798cfc445bf-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:19:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "cinder-85123658-2bfa-44de-bbc3-8583b2e3fcf1-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-85123658-2bfa-44de-bbc3-8583b2e3fcf1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "cinder-quobyte-85123658-2bfa-44de-bbc3-8583b2e3fcf1" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-quobyte-85123658-2bfa-44de-bbc3-8583b2e3fcf1" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[363ed279-a376-457d-9562-a7d44d6def9b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:11 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1 Sep 07 02:19:11 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:12 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1" returned: 0 in 0.498s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:12 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1 Sep 07 02:19:12 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:12 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-85123658-2bfa-44de-bbc3-8583b2e3fcf1" returned: 0 in 0.286s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-quobyte-85123658-2bfa-44de-bbc3-8583b2e3fcf1" released by "delete_volume" :: held 0.849s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:19:12 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Created reservations ['30604118-1d83-4c12-b30a-223893e12ac7', '31e46969-81d5-43dc-b189-dec42dc762ea', '6938b52a-0a78-43c4-9278-f2cd065fce3b', 'bbdfef92-90c3-47ac-af94-009d3f13f170'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:19:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:12 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:19:12 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:13 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.331s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:13 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:19:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Deleted volume successfully. Sep 07 02:19:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-44aef109-3aa4-480f-a481-27af1d3915d1 tempest-VolumesListTestJSON-1398198946 None] Lock "cinder-85123658-2bfa-44de-bbc3-8583b2e3fcf1-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:19:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-24a78edd-9c27-46e7-9ae4-10afc2c7d4a5 req-c76ae8dc-601e-49fd-8cb6-95d226c6b1da tempest-ServerActionsTestOtherA-678111813 None] Terminate volume connection completed successfully. Sep 07 02:19:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-24a78edd-9c27-46e7-9ae4-10afc2c7d4a5 req-c76ae8dc-601e-49fd-8cb6-95d226c6b1da tempest-ServerActionsTestOtherA-678111813 None] Deleting attachment 3618a317-eee2-4d81-b45b-e5f28759d3c8. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:19:22 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:19:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Flow 'volume_create_manager' (92ded0a5-74c0-4056-9707-f9593364b72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b5e5d3-6a05-4950-aab3-874e1274bb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b5e5d3-6a05-4950-aab3-874e1274bb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-155141041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c1a0819d6a40b79b7494c3e204ff49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:23Z,use_quota=True,user_id='e9485cf921c24a959fc443d7cd5eaa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99385fca-6864-48bb-bbce-eb1fbce77f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99385fca-6864-48bb-bbce-eb1fbce77f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db64607-f7b5-498a-8256-81cb60f59a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:22 devstack cinder-volume[87313]: DEBUG cinder.image.glance [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Creating Keystone auth plugin from conf {{(pid=87313) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 02:19:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db64607-f7b5-498a-8256-81cb60f59a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e', 'volume_name': 'volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392bc9d8-2751-44e1-8aad-c5baf366418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392bc9d8-2751-44e1-8aad-c5baf366418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b21866-383b-4948-b3c5-78c5befc13e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:23 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Volume b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 02:19:23 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Trying to clone b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e from image 923d33a7-8f5b-413a-bd44-620eb1f09c8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]). {{(pid=87313) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 02:19:24 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 02:19:24 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Image download 20.69 MB at 20.69 MB/s Sep 07 02:19:24 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18df07b-f2bf-45d9-8cad-292e7f5b4d95]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:24 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD Sep 07 02:19:24 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:24 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:24 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Temporary image 923d33a7-8f5b-413a-bd44-620eb1f09c8b is fetched for user e9485cf921c24a959fc443d7cd5eaa3c. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 02:19:24 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:DELETE=10,cinder:SELECT=97,cinder:INSERT=24,cinder:UPDATE=115 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:19:24 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d3ee51-1f8e-49d4-87fc-05d0d727713a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:25 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD Sep 07 02:19:25 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:25 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-155141041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c1a0819d6a40b79b7494c3e204ff49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:23Z,use_quota=True,user_id='e9485cf921c24a959fc443d7cd5eaa3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Creating volume b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:19:25 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:25 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e 1073741824 Sep 07 02:19:25 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:25 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e 1073741824" returned: 0 in 0.555s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:26 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e Sep 07 02:19:26 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:26 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:19:26 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:26 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e" returned: 0 in 0.298s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Attempting download of 923d33a7-8f5b-413a-bd44-620eb1f09c8b ((None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}])) to volume b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa8f45a-8e58-40a4-a9aa-1518fbfccbc6]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_dfpdgrnh {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:26 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.332s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:19:26 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_dfpdgrnh Sep 07 02:19:26 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:26 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_dfpdgrnh" returned: 0 in 0.399s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_dfpdgrnh {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:26 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_dfpdgrnh Sep 07 02:19:26 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:27 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_dfpdgrnh" returned: 1 in 0.361s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_dfpdgrnh' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:19:27 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6abd51-5c62-464a-a844-7eb1c6042b43]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:27 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD Sep 07 02:19:27 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:27 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:27 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] 923d33a7-8f5b-413a-bd44-620eb1f09c8b was qcow2, converting to qcow2 {{(pid=87313) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 02:19:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:27 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e Sep 07 02:19:27 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:30 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e" returned: 0 in 2.767s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:30 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_1ru0na5jdevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:19:30 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Converted 112.00 MB image at 40.45 MB/s Sep 07 02:19:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:30 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e 1G Sep 07 02:19:30 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:30 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e 1G" returned: 0 in 0.567s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:30 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Downloaded image 923d33a7-8f5b-413a-bd44-620eb1f09c8b ((None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}])) to volume b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e successfully. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 02:19:30 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Temporary image 923d33a7-8f5b-413a-bd44-620eb1f09c8b for user e9485cf921c24a959fc443d7cd5eaa3c is deleted. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 02:19:30 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Marking volume b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e as bootable. {{(pid=87313) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 02:19:30 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Copying metadata from image 923d33a7-8f5b-413a-bd44-620eb1f09c8b to b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e. {{(pid=87313) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 02:19:30 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Creating volume glance metadata for volume b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e backed by image 923d33a7-8f5b-413a-bd44-620eb1f09c8b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87313) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 02:19:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b21866-383b-4948-b3c5-78c5befc13e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a2488e-c5a9-4764-b2e3-6c9b61057815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:31 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Volume volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e (b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e): created successfully Sep 07 02:19:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a2488e-c5a9-4764-b2e3-6c9b61057815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Flow 'volume_create_manager' (92ded0a5-74c0-4056-9707-f9593364b72c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3ec8c516-e6e6-4879-a518-b9d8c3df03bb tempest-ServerActionsTestOtherA-678111813 None] Created volume successfully. Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Flow 'volume_create_manager' (0a71885a-0e2f-4ef1-8209-0d8dc5b2fb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59568acb-6270-4e96-b8a6-87f6b84c4f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59568acb-6270-4e96-b8a6-87f6b84c4f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1822423879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f647af57-92b0-4e5b-b985-d3a3db087358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebd351209ac43a49156d70b02e11d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:35Z,use_quota=True,user_id='d926748f27fc4ffcb1e403d42519cbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bc4dc0-2233-4677-b799-a134eb9b3798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bc4dc0-2233-4677-b799-a134eb9b3798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79d7271-9f6c-485f-848f-4a57a972f865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79d7271-9f6c-485f-848f-4a57a972f865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f647af57-92b0-4e5b-b985-d3a3db087358', 'volume_name': 'volume-f647af57-92b0-4e5b-b985-d3a3db087358', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377243fd-772a-4d9f-bf73-06851ae8c6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377243fd-772a-4d9f-bf73-06851ae8c6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d83264-4bfd-4992-a324-c5d5d159d1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:34 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume f647af57-92b0-4e5b-b985-d3a3db087358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f647af57-92b0-4e5b-b985-d3a3db087358', 'volume_size': 1} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1822423879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f647af57-92b0-4e5b-b985-d3a3db087358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebd351209ac43a49156d70b02e11d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:35Z,use_quota=True,user_id='d926748f27fc4ffcb1e403d42519cbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Creating volume f647af57-92b0-4e5b-b985-d3a3db087358 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:19:34 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:19:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:34 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 1073741824 Sep 07 02:19:34 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:35 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 1073741824" returned: 0 in 0.647s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:35 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 Sep 07 02:19:35 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:36 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358" returned: 0 in 0.516s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:19:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d83264-4bfd-4992-a324-c5d5d159d1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f647af57-92b0-4e5b-b985-d3a3db087358', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3369a00d-d12c-4b75-9ee9-7502af4116a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:36 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume volume-f647af57-92b0-4e5b-b985-d3a3db087358 (f647af57-92b0-4e5b-b985-d3a3db087358): created successfully Sep 07 02:19:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3369a00d-d12c-4b75-9ee9-7502af4116a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Flow 'volume_create_manager' (0a71885a-0e2f-4ef1-8209-0d8dc5b2fb35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e25d611e-277a-4dd8-9ad1-42121f121755 tempest-VolumesSnapshotTestJSON-1472382704 None] Created volume successfully. Sep 07 02:19:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] Creating offline snapshot bc476436-519d-4f3c-a7f5-bdabe6032d00 of volume f647af57-92b0-4e5b-b985-d3a3db087358 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:19:37 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b7d017-2d2b-4c0d-b67a-96909ddd480f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:38 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 Sep 07 02:19:38 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-ed4b1fea-f149-4ba6-91ca-3681f352af85 req-52ddcf69-40b1-4dfb-9f8f-1e1473f38385 tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:38 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358" returned: 0 in 0.543s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:38 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 1G Sep 07 02:19:38 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:39 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 1G" returned: 0 in 0.829s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f647af57-92b0-4e5b-b985-d3a3db087358 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:39 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f647af57-92b0-4e5b-b985-d3a3db087358 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 Sep 07 02:19:39 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:39 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f647af57-92b0-4e5b-b985-d3a3db087358 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00" returned: 0 in 0.543s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:39 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 is being set with open permissions: ugo+rw Sep 07 02:19:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:39 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 Sep 07 02:19:39 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:40 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00" returned: 0 in 0.584s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:40 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.info Sep 07 02:19:40 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:40 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.info" returned: 0 in 0.439s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:40 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.info is being set with open permissions: ugo+rw Sep 07 02:19:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:40 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.info Sep 07 02:19:40 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.info" returned: 0 in 0.334s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:41 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.457s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-ed4b1fea-f149-4ba6-91ca-3681f352af85 req-52ddcf69-40b1-4dfb-9f8f-1e1473f38385 tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.969s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-ed4b1fea-f149-4ba6-91ca-3681f352af85 req-52ddcf69-40b1-4dfb-9f8f-1e1473f38385 tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-ed4b1fea-f149-4ba6-91ca-3681f352af85 req-52ddcf69-40b1-4dfb-9f8f-1e1473f38385 tempest-ServerActionsTestOtherA-678111813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0ae6a4c-55d6-4670-b6a5-a5d53835afb0', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:19:41 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7f536ff8-2f1a-4c15-b084-e60e8da18a73 tempest-VolumesSnapshotTestJSON-1472382704 None] Create snapshot completed successfully Sep 07 02:19:41 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-ed4b1fea-f149-4ba6-91ca-3681f352af85 req-52ddcf69-40b1-4dfb-9f8f-1e1473f38385 tempest-ServerActionsTestOtherA-678111813 None] attachment_update completed successfully. Sep 07 02:19:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-bc476436-519d-4f3c-a7f5-bdabe6032d00-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-bc476436-519d-4f3c-a7f5-bdabe6032d00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-f647af57-92b0-4e5b-b985-d3a3db087358" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-f647af57-92b0-4e5b-b985-d3a3db087358" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-bc476436-519d-4f3c-a7f5-bdabe6032d00" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-bc476436-519d-4f3c-a7f5-bdabe6032d00" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Deleting offline snapshot bc476436-519d-4f3c-a7f5-bdabe6032d00 of volume f647af57-92b0-4e5b-b985-d3a3db087358 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:19:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] snapshot_file for this snap is: volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:19:42 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1cb168-c80e-4a4f-9d55-8d6ac106f241]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:42 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 Sep 07 02:19:42 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:43 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00" returned: 0 in 0.523s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f647af57-92b0-4e5b-b985-d3a3db087358(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:19:43 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb87fc13-4d80-4b91-b694-76e258a03c2b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:43 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 Sep 07 02:19:43 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:43 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358" returned: 0 in 0.534s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:43 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 Sep 07 02:19:43 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:44 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00" returned: 0 in 0.535s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:44 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00 Sep 07 02:19:44 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:44 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358.bc476436-519d-4f3c-a7f5-bdabe6032d00" returned: 0 in 0.477s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-bc476436-519d-4f3c-a7f5-bdabe6032d00" released by "_delete_snapshot" :: held 2.239s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:19:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-f647af57-92b0-4e5b-b985-d3a3db087358" released by "delete_snapshot" :: held 2.271s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:19:44 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Created reservations ['2bfff230-d19c-4e42-ac7d-479550ab447c', '723c07a8-6739-4a20-9b68-49132fe7adff', 'b1ac1a59-ef0b-4fa7-a475-e1b5425c4a16', '13b756b1-a2f0-4b87-96b7-323e22b7bb55'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:19:44 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Delete snapshot completed successfully. Sep 07 02:19:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29f681ca-8b7a-4186-85bd-7f7f6046daf8 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-bc476436-519d-4f3c-a7f5-bdabe6032d00-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Flow 'volume_create_manager' (729fc5fc-fa8b-46a8-b3c9-23c5f56c6adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac9c388-5fec-4af7-b519-908f3cd6cde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac9c388-5fec-4af7-b519-908f3cd6cde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-555456941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70641538-b402-409e-845e-89ecb23bbe99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebd351209ac43a49156d70b02e11d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:47Z,use_quota=True,user_id='d926748f27fc4ffcb1e403d42519cbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9168ac6f-a15b-4342-97d1-443368b3f7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9168ac6f-a15b-4342-97d1-443368b3f7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4e611d-2a23-48f9-914a-9cc4a8a4eb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4e611d-2a23-48f9-914a-9cc4a8a4eb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70641538-b402-409e-845e-89ecb23bbe99', 'volume_name': 'volume-70641538-b402-409e-845e-89ecb23bbe99', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e69e413-f3c6-4604-9d2b-6b1d1c68c4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e69e413-f3c6-4604-9d2b-6b1d1c68c4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c20782-8270-4761-a24c-3f69bc32a8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:46 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume 70641538-b402-409e-845e-89ecb23bbe99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70641538-b402-409e-845e-89ecb23bbe99', 'volume_size': 1} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-555456941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70641538-b402-409e-845e-89ecb23bbe99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebd351209ac43a49156d70b02e11d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:47Z,use_quota=True,user_id='d926748f27fc4ffcb1e403d42519cbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Creating volume 70641538-b402-409e-845e-89ecb23bbe99 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:19:46 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:19:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:46 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 1073741824 Sep 07 02:19:46 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:47 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 1073741824" returned: 0 in 0.718s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:47 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 Sep 07 02:19:47 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:47 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99" returned: 0 in 0.398s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:19:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c20782-8270-4761-a24c-3f69bc32a8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70641538-b402-409e-845e-89ecb23bbe99', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab0841f-a13c-4239-be02-86e4ef02c8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:48 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume volume-70641538-b402-409e-845e-89ecb23bbe99 (70641538-b402-409e-845e-89ecb23bbe99): created successfully Sep 07 02:19:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab0841f-a13c-4239-be02-86e4ef02c8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Flow 'volume_create_manager' (729fc5fc-fa8b-46a8-b3c9-23c5f56c6adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:48 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7d383dcb-aade-4c0c-82cf-0143e260d8b8 tempest-VolumesSnapshotTestJSON-1472382704 None] Created volume successfully. Sep 07 02:19:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] Creating offline snapshot 50546c37-e8ce-4e73-b3f7-d887bb197f5d of volume 70641538-b402-409e-845e-89ecb23bbe99 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:19:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[255ded27-b3f8-4583-8d82-c04ce459c238]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:49 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 Sep 07 02:19:49 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:49 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99" returned: 0 in 0.526s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:49 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d 1G Sep 07 02:19:49 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:50 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d 1G" returned: 0 in 0.617s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70641538-b402-409e-845e-89ecb23bbe99 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:50 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70641538-b402-409e-845e-89ecb23bbe99 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d Sep 07 02:19:50 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:50 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70641538-b402-409e-845e-89ecb23bbe99 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d" returned: 0 in 0.529s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:50 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d is being set with open permissions: ugo+rw Sep 07 02:19:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:50 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d Sep 07 02:19:50 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:51 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d" returned: 0 in 0.422s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:51 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.info Sep 07 02:19:51 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:51 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.info" returned: 0 in 0.701s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:51 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.info is being set with open permissions: ugo+rw Sep 07 02:19:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:51 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.info Sep 07 02:19:51 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:52 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.info" returned: 0 in 0.497s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.501s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b666e0ca-f83e-4a9f-8d52-f02d0b9a88c5 tempest-VolumesSnapshotTestJSON-1472382704 None] Create snapshot completed successfully Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Flow 'volume_create_manager' (9dbda9ec-2d10-4a0b-9e99-3063ca8c0c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2422ad52-75b2-4268-94f6-d7175bd53c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2422ad52-75b2-4268-94f6-d7175bd53c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1325316377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612dd72a-80eb-4dab-adff-dd8ea0189e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebd351209ac43a49156d70b02e11d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=50546c37-e8ce-4e73-b3f7-d887bb197f5d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:54Z,use_quota=True,user_id='d926748f27fc4ffcb1e403d42519cbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6d98bd-79e6-41ff-b2ed-e4279cd2bdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6d98bd-79e6-41ff-b2ed-e4279cd2bdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15dd57f-8a66-41b0-acba-87a5af805062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15dd57f-8a66-41b0-acba-87a5af805062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '612dd72a-80eb-4dab-adff-dd8ea0189e90', 'volume_name': 'volume-612dd72a-80eb-4dab-adff-dd8ea0189e90', 'volume_size': 2, 'snapshot_id': '50546c37-e8ce-4e73-b3f7-d887bb197f5d'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ddc453-9858-44fb-bda1-525459ccd44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ddc453-9858-44fb-bda1-525459ccd44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58154d8-f048-4bdc-888b-1f623b470d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:54 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume 612dd72a-80eb-4dab-adff-dd8ea0189e90: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-612dd72a-80eb-4dab-adff-dd8ea0189e90', 'volume_size': 2, 'snapshot_id': '50546c37-e8ce-4e73-b3f7-d887bb197f5d'} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-50546c37-e8ce-4e73-b3f7-d887bb197f5d-612dd72a-80eb-4dab-adff-dd8ea0189e90" by "_create_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-50546c37-e8ce-4e73-b3f7-d887bb197f5d-612dd72a-80eb-4dab-adff-dd8ea0189e90" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Creating volume 612dd72a-80eb-4dab-adff-dd8ea0189e90 from snapshot 50546c37-e8ce-4e73-b3f7-d887bb197f5d {{(pid=87313) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-612dd72a-80eb-4dab-adff-dd8ea0189e90" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-612dd72a-80eb-4dab-adff-dd8ea0189e90" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] snapshot: 50546c37-e8ce-4e73-b3f7-d887bb197f5d, volume: 612dd72a-80eb-4dab-adff-dd8ea0189e90, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69daf6e-5405-44bb-a5e8-da4a7534a01c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:54 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d Sep 07 02:19:54 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:54 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d" returned: 0 in 0.488s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70641538-b402-409e-845e-89ecb23bbe99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a207b081-2555-45e7-b2a9-284dabd622ac]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:19:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:55 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 Sep 07 02:19:55 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:55 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 07 02:19:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99" returned: 0 in 0.781s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:19:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:19:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:19:55 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:19:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:19:55 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 Sep 07 02:19:55 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Flow 'volume_create_manager' (2fa4aaeb-f598-4543-8628-b05dfac62dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f96ad5d-bdb1-4300-8067-9a29934e56e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f96ad5d-bdb1-4300-8067-9a29934e56e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1669420641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7afe189-e828-4c6e-9652-cd234888dd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a523a306edb4c81889e2f6b861c3c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:59Z,use_quota=True,user_id='dae831d0ce3b4fc188d00ca8a192a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7479b302-dc9e-4b06-a463-95e32ea5a730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7479b302-dc9e-4b06-a463-95e32ea5a730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ec36bf-b56d-474e-95b1-b54452ca0e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ec36bf-b56d-474e-95b1-b54452ca0e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7afe189-e828-4c6e-9652-cd234888dd29', 'volume_name': 'volume-c7afe189-e828-4c6e-9652-cd234888dd29', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8db3492-e9e9-4bbc-bb56-fb7ea5fb61b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8db3492-e9e9-4bbc-bb56-fb7ea5fb61b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34cf00d-3cbf-4b40-9196-db42b9837850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:19:59 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Volume c7afe189-e828-4c6e-9652-cd234888dd29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7afe189-e828-4c6e-9652-cd234888dd29', 'volume_size': 1} Sep 07 02:19:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:02 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=62,cinder:SELECT=65,cinder:DELETE=4,cinder:INSERT=20 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:20:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-f04e635c-e9bf-4772-ac34-0cb4d3c95379 req-a11d5898-b3ed-428a-b1f1-56806d518a49 tempest-ServerActionsTestOtherA-678111813 None] Terminate volume connection completed successfully. Sep 07 02:20:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-f04e635c-e9bf-4772-ac34-0cb4d3c95379 req-a11d5898-b3ed-428a-b1f1-56806d518a49 tempest-ServerActionsTestOtherA-678111813 None] Deleting attachment c0ae6a4c-55d6-4670-b6a5-a5d53835afb0. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:20:03 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90" returned: 0 in 8.190s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:03 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99, size 1024.00 MB, duration 8.19 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:20:03 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Converted 1024.00 MB image at 125.02 MB/s Sep 07 02:20:03 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 is being set with open permissions: ugo+rw Sep 07 02:20:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:03 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 Sep 07 02:20:03 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:04 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90" returned: 0 in 0.285s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-612dd72a-80eb-4dab-adff-dd8ea0189e90" released by "_copy_volume_from_snapshot" :: held 9.914s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-50546c37-e8ce-4e73-b3f7-d887bb197f5d-612dd72a-80eb-4dab-adff-dd8ea0189e90" released by "_create_volume_from_snapshot" :: held 10.014s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.040s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.425s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1669420641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7afe189-e828-4c6e-9652-cd234888dd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a523a306edb4c81889e2f6b861c3c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:19:59Z,use_quota=True,user_id='dae831d0ce3b4fc188d00ca8a192a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Creating volume c7afe189-e828-4c6e-9652-cd234888dd29 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:20:04 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:04 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29 1073741824 Sep 07 02:20:04 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58154d8-f048-4bdc-888b-1f623b470d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612dd72a-80eb-4dab-adff-dd8ea0189e90', 'volume_size': 2, 'snapshot_id': '50546c37-e8ce-4e73-b3f7-d887bb197f5d'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127510cd-d39b-48a3-a358-7b0b9317e21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:04 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 (612dd72a-80eb-4dab-adff-dd8ea0189e90): created successfully Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127510cd-d39b-48a3-a358-7b0b9317e21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Flow 'volume_create_manager' (9dbda9ec-2d10-4a0b-9e99-3063ca8c0c06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:04 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a1285325-2572-47a7-b3e3-fd6190d21697 tempest-VolumesSnapshotTestJSON-1472382704 None] Created volume successfully. Sep 07 02:20:04 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29 1073741824" returned: 0 in 0.538s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:04 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29 Sep 07 02:20:04 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-612dd72a-80eb-4dab-adff-dd8ea0189e90-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-612dd72a-80eb-4dab-adff-dd8ea0189e90-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-612dd72a-80eb-4dab-adff-dd8ea0189e90" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-612dd72a-80eb-4dab-adff-dd8ea0189e90" acquired by "delete_volume" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8385219-d411-40ae-9f49-1525e1e5265f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:05 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 Sep 07 02:20:05 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:05 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29" returned: 0 in 0.522s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34cf00d-3cbf-4b40-9196-db42b9837850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7afe189-e828-4c6e-9652-cd234888dd29', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5c21f6-1052-49fe-8057-1c93491c57f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:05 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Volume volume-c7afe189-e828-4c6e-9652-cd234888dd29 (c7afe189-e828-4c6e-9652-cd234888dd29): created successfully Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5c21f6-1052-49fe-8057-1c93491c57f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Flow 'volume_create_manager' (2fa4aaeb-f598-4543-8628-b05dfac62dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ef8a5978-51ce-4f61-be76-e4b6feca8b16 tempest-AttachVolumeTestJSON-1145787406 None] Created volume successfully. Sep 07 02:20:05 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90" returned: 0 in 0.520s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:05 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90 Sep 07 02:20:05 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:06 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-612dd72a-80eb-4dab-adff-dd8ea0189e90" returned: 0 in 0.375s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-612dd72a-80eb-4dab-adff-dd8ea0189e90" released by "delete_volume" :: held 0.994s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Created reservations ['a02683a8-5594-485e-86b5-bfed6ba48d8a', 'af5d5039-b731-4baf-acdb-62653d93e783', '308c5f96-882d-4ab1-8233-9a55192c5010', 'dff03b94-1353-486f-8d18-66c1df4149d4'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:06 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:06 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-f04e635c-e9bf-4772-ac34-0cb4d3c95379 req-42245b15-94fc-4c76-bcbd-d428271d62e5 tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-f04e635c-e9bf-4772-ac34-0cb4d3c95379 req-42245b15-94fc-4c76-bcbd-d428271d62e5 tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-f04e635c-e9bf-4772-ac34-0cb4d3c95379 req-42245b15-94fc-4c76-bcbd-d428271d62e5 tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-f04e635c-e9bf-4772-ac34-0cb4d3c95379 req-42245b15-94fc-4c76-bcbd-d428271d62e5 tempest-ServerActionsTestOtherA-678111813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '980a2a1b-9a61-4893-b4d8-f7ec309e21b8', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:20:06 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.413s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:06 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Deleted volume successfully. Sep 07 02:20:06 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-f04e635c-e9bf-4772-ac34-0cb4d3c95379 req-42245b15-94fc-4c76-bcbd-d428271d62e5 tempest-ServerActionsTestOtherA-678111813 None] attachment_update completed successfully. Sep 07 02:20:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-39ccb426-d6f7-4a92-b161-7a53dd3dab90 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-612dd72a-80eb-4dab-adff-dd8ea0189e90-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-d14b858d-0c06-4a21-a6b0-1ba2f326824d req-6ecf3de7-2b3b-464b-945b-d319cbc4a0ae tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-d14b858d-0c06-4a21-a6b0-1ba2f326824d req-6ecf3de7-2b3b-464b-945b-d319cbc4a0ae tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-d14b858d-0c06-4a21-a6b0-1ba2f326824d req-6ecf3de7-2b3b-464b-945b-d319cbc4a0ae tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-d14b858d-0c06-4a21-a6b0-1ba2f326824d req-6ecf3de7-2b3b-464b-945b-d319cbc4a0ae tempest-AttachVolumeTestJSON-1145787406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-c7afe189-e828-4c6e-9652-cd234888dd29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a7d1fb3-ebfd-453f-88b6-a620a21ea1f8', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-50546c37-e8ce-4e73-b3f7-d887bb197f5d-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-50546c37-e8ce-4e73-b3f7-d887bb197f5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-70641538-b402-409e-845e-89ecb23bbe99" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-70641538-b402-409e-845e-89ecb23bbe99" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-50546c37-e8ce-4e73-b3f7-d887bb197f5d" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:07 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-d14b858d-0c06-4a21-a6b0-1ba2f326824d req-6ecf3de7-2b3b-464b-945b-d319cbc4a0ae tempest-AttachVolumeTestJSON-1145787406 None] attachment_update completed successfully. Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-50546c37-e8ce-4e73-b3f7-d887bb197f5d" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Deleting offline snapshot 50546c37-e8ce-4e73-b3f7-d887bb197f5d of volume 70641538-b402-409e-845e-89ecb23bbe99 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] snapshot_file for this snap is: volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[22422ed1-5c57-4f3e-a1bc-d19ef9b859bf]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:07 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d Sep 07 02:20:07 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:08 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d" returned: 0 in 0.609s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70641538-b402-409e-845e-89ecb23bbe99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:20:08 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b6e6ca-0b73-4698-bcac-9259b229d44f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:08 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 Sep 07 02:20:08 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:09 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99" returned: 0 in 0.920s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:09 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d Sep 07 02:20:09 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:09 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d" returned: 0 in 0.645s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:09 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d Sep 07 02:20:09 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:10 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99.50546c37-e8ce-4e73-b3f7-d887bb197f5d" returned: 0 in 0.520s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-50546c37-e8ce-4e73-b3f7-d887bb197f5d" released by "_delete_snapshot" :: held 2.910s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-70641538-b402-409e-845e-89ecb23bbe99" released by "delete_snapshot" :: held 2.960s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:10 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Created reservations ['a21ee880-f807-4c68-9fba-9d0c4178de0b', '6ce408f4-47e8-4e9d-90ed-19a259dfc1e2', '69481bed-321b-4568-bf04-e24ac044fc15', '6364f3cc-8319-47f8-84f4-8d6deaa396cd'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Delete snapshot completed successfully. Sep 07 02:20:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-37b9aa16-fe0a-4c1b-a2a5-29b084f22716 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-50546c37-e8ce-4e73-b3f7-d887bb197f5d-delete_snapshot" released by "delete_snapshot" :: held 3.358s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-70641538-b402-409e-845e-89ecb23bbe99-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-70641538-b402-409e-845e-89ecb23bbe99-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-70641538-b402-409e-845e-89ecb23bbe99" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-70641538-b402-409e-845e-89ecb23bbe99" acquired by "delete_volume" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:12 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73c3950-b546-4ba1-89e6-41d47f87b85c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:12 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 Sep 07 02:20:12 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:12 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99" returned: 0 in 0.538s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:12 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99 Sep 07 02:20:12 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:13 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-70641538-b402-409e-845e-89ecb23bbe99" returned: 0 in 0.418s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-70641538-b402-409e-845e-89ecb23bbe99" released by "delete_volume" :: held 1.085s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:13 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Created reservations ['87c9d4e1-bd76-4adb-9d21-26f41b067fae', 'da5dfb47-8bae-4e9f-9b3e-4e284ddef15a', '7413f9ae-f264-4ecd-b4be-44a7106b9160', 'ec028d20-3164-486c-b88a-cfb31df742f6'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:13 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:13 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:13 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.364s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:14 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:14 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Deleted volume successfully. Sep 07 02:20:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f69cf7e5-a477-422e-8205-e2d81fad592c tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-70641538-b402-409e-845e-89ecb23bbe99-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Flow 'volume_create_manager' (3389a9d8-3ce6-4e99-af6f-ace8aa34aca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6fa33a-ab1f-4e1b-a937-d35ca9c00490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6fa33a-ab1f-4e1b-a937-d35ca9c00490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1783976677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23c9f5b-3292-4e29-b60a-2dab55d4f399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebd351209ac43a49156d70b02e11d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:16Z,use_quota=True,user_id='d926748f27fc4ffcb1e403d42519cbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c01673-6513-41bf-9b1a-36a7cb45f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c01673-6513-41bf-9b1a-36a7cb45f651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2463289-d85c-4079-934c-3166dcb68274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2463289-d85c-4079-934c-3166dcb68274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e23c9f5b-3292-4e29-b60a-2dab55d4f399', 'volume_name': 'volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ec6dec-ed83-47d7-be2a-4385ce815cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ec6dec-ed83-47d7-be2a-4385ce815cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ecd6a8-8edc-4557-a4d0-06f210caca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:16 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Volume e23c9f5b-3292-4e29-b60a-2dab55d4f399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399', 'volume_size': 1} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1783976677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23c9f5b-3292-4e29-b60a-2dab55d4f399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebd351209ac43a49156d70b02e11d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:16Z,use_quota=True,user_id='d926748f27fc4ffcb1e403d42519cbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Creating volume e23c9f5b-3292-4e29-b60a-2dab55d4f399 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:20:16 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:20:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:16 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 1073741824 Sep 07 02:20:16 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:17 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 1073741824" returned: 0 in 1.481s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:18 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 Sep 07 02:20:18 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:18 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399" returned: 0 in 0.815s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] <== create_volume: return (2506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:20:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.519s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ecd6a8-8edc-4557-a4d0-06f210caca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1cfcf2-4013-409b-9bcc-12f29622053c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:19 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Volume volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 (e23c9f5b-3292-4e29-b60a-2dab55d4f399): created successfully Sep 07 02:20:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1cfcf2-4013-409b-9bcc-12f29622053c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Flow 'volume_create_manager' (3389a9d8-3ce6-4e99-af6f-ace8aa34aca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:19 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f6a4b592-81fd-465f-9afb-2a6581ae2ddd tempest-VolumesSnapshotTestJSON-1472382704 None] Created volume successfully. Sep 07 02:20:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] Creating offline snapshot 918229fb-e734-4a31-8536-20453657afc6 of volume e23c9f5b-3292-4e29-b60a-2dab55d4f399 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:20:20 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0f72c7-080e-4c36-a0fe-189bb0303849]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:20 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 Sep 07 02:20:20 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:21 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399" returned: 0 in 0.737s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:21 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 1G Sep 07 02:20:21 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:22 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 1G" returned: 0 in 1.062s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:22 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 Sep 07 02:20:22 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (46637fcd-6ef6-46e3-8b5d-e097fd7c8218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee591fab-6721-4f88-8e05-f806ac0e46e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:22 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee591fab-6721-4f88-8e05-f806ac0e46e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1923041388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1bd7fa-8db4-4d8e-89ea-82046fcaa361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:23Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2539d84-4666-4807-8dc2-eaf808190036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2539d84-4666-4807-8dc2-eaf808190036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dceec6-5aaa-4b05-ad8d-dbf2cb44d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dceec6-5aaa-4b05-ad8d-dbf2cb44d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb1bd7fa-8db4-4d8e-89ea-82046fcaa361', 'volume_name': 'volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb28e3be-7102-44e5-83bc-f0b0497b41c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb28e3be-7102-44e5-83bc-f0b0497b41c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f62703-8794-4cc1-91f5-d4e00cb35237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:22 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Volume eb1bd7fa-8db4-4d8e-89ea-82046fcaa361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361', 'volume_size': 1} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6" returned: 0 in 0.517s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:22 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 is being set with open permissions: ugo+rw Sep 07 02:20:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:22 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 Sep 07 02:20:22 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:23 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6" returned: 0 in 0.250s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:23 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.info Sep 07 02:20:23 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:23 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.info" returned: 0 in 0.327s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:23 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.info is being set with open permissions: ugo+rw Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:23 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.info Sep 07 02:20:23 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:23 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.info" returned: 0 in 0.296s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.384s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1923041388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1bd7fa-8db4-4d8e-89ea-82046fcaa361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:23Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Creating volume eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:20:23 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:20:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:23 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 1073741824 Sep 07 02:20:23 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:23 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6da8d3d7-28b0-4a29-860c-a1e3b4662a80 tempest-VolumesSnapshotTestJSON-1472382704 None] Create snapshot completed successfully Sep 07 02:20:24 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 1073741824" returned: 0 in 0.547s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:24 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 Sep 07 02:20:24 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:24 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361" returned: 0 in 0.413s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:24 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:20:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f62703-8794-4cc1-91f5-d4e00cb35237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2123ba31-41a7-4f6e-9367-b9c89bf20233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:24 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Volume volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 (eb1bd7fa-8db4-4d8e-89ea-82046fcaa361): created successfully Sep 07 02:20:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2123ba31-41a7-4f6e-9367-b9c89bf20233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (46637fcd-6ef6-46e3-8b5d-e097fd7c8218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:24 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9d36aeb8-0040-4024-a785-76af7f8b00b5 tempest-VolumesActionsTest-1572922141 None] Created volume successfully. Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Flow 'volume_create_manager' (2e9ce2a2-f2a2-420c-a17f-a0662ed95f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5b96a1-ae0f-4d60-b10c-8b9815553d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=82,cinder:INSERT=18,cinder:UPDATE=59,cinder:DELETE=7 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5b96a1-ae0f-4d60-b10c-8b9815553d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1484427383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2101f5a-c5b5-42be-81f2-c279c011e990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebd351209ac43a49156d70b02e11d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=918229fb-e734-4a31-8536-20453657afc6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:25Z,use_quota=True,user_id='d926748f27fc4ffcb1e403d42519cbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9a7fb3-a8c4-4f55-8fcf-4ae3856fec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9a7fb3-a8c4-4f55-8fcf-4ae3856fec35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc53465-4665-4981-a5d3-ac54455d17a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc53465-4665-4981-a5d3-ac54455d17a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2101f5a-c5b5-42be-81f2-c279c011e990', 'volume_name': 'volume-b2101f5a-c5b5-42be-81f2-c279c011e990', 'volume_size': 1, 'snapshot_id': '918229fb-e734-4a31-8536-20453657afc6'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52e692f-6004-4d5d-af7e-42df80af0f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52e692f-6004-4d5d-af7e-42df80af0f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cc816d-9e83-463b-9150-f99c65e8bc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:25 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume b2101f5a-c5b5-42be-81f2-c279c011e990: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2101f5a-c5b5-42be-81f2-c279c011e990', 'volume_size': 1, 'snapshot_id': '918229fb-e734-4a31-8536-20453657afc6'} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-918229fb-e734-4a31-8536-20453657afc6-b2101f5a-c5b5-42be-81f2-c279c011e990" by "_create_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-918229fb-e734-4a31-8536-20453657afc6-b2101f5a-c5b5-42be-81f2-c279c011e990" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Creating volume b2101f5a-c5b5-42be-81f2-c279c011e990 from snapshot 918229fb-e734-4a31-8536-20453657afc6 {{(pid=87313) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-b2101f5a-c5b5-42be-81f2-c279c011e990" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-b2101f5a-c5b5-42be-81f2-c279c011e990" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] snapshot: 918229fb-e734-4a31-8536-20453657afc6, volume: b2101f5a-c5b5-42be-81f2-c279c011e990, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de86c401-a51b-4b78-8ac4-38efaf37ca80 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361" by "attach_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[834d9f3e-24bf-4296-be03-60eb939c04fe]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de86c401-a51b-4b78-8ac4-38efaf37ca80 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361" acquired by "attach_volume" :: waited 0.047s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:26 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-de86c401-a51b-4b78-8ac4-38efaf37ca80 tempest-VolumesActionsTest-1572922141 None] Attaching volume eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 to instance 06b51f91-425f-473d-8d49-9245510fdd84 at mountpoint /dev/vdb on host None. Sep 07 02:20:26 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-de86c401-a51b-4b78-8ac4-38efaf37ca80 tempest-VolumesActionsTest-1572922141 None] Attach volume completed successfully. Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de86c401-a51b-4b78-8ac4-38efaf37ca80 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361" released by "attach_volume" :: held 0.196s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:26 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 Sep 07 02:20:26 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:26 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:26 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:26 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6" returned: 0 in 0.785s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b636c99-91e4-413a-bbdf-3c037c84ce9d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:26 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.544s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:20:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:20:26 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 Sep 07 02:20:26 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a59e3884-32b0-4109-8180-0d759ffcab6f tempest-VolumesActionsTest-1116088043 None] Terminate volume connection completed successfully. Sep 07 02:20:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a59e3884-32b0-4109-8180-0d759ffcab6f tempest-VolumesActionsTest-1116088043 None] Acquiring lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361-detach_volume" by "detach_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a59e3884-32b0-4109-8180-0d759ffcab6f tempest-VolumesActionsTest-1116088043 None] Lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:27 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a59e3884-32b0-4109-8180-0d759ffcab6f tempest-VolumesActionsTest-1116088043 None] Detaching volume eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 from instance 06b51f91-425f-473d-8d49-9245510fdd84. Sep 07 02:20:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399" returned: 0 in 0.708s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:20:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:20:27 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990 not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:20:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:27 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990 Sep 07 02:20:27 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a59e3884-32b0-4109-8180-0d759ffcab6f tempest-VolumesActionsTest-1116088043 None] Detach volume completed successfully. Sep 07 02:20:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a59e3884-32b0-4109-8180-0d759ffcab6f tempest-VolumesActionsTest-1116088043 None] Lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361-detach_volume" released by "detach_volume" :: held 0.162s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-94e78242-2f8f-417b-b487-d92620f8dd71 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361-detach_volume" by "detach_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-94e78242-2f8f-417b-b487-d92620f8dd71 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-94e78242-2f8f-417b-b487-d92620f8dd71 tempest-VolumesActionsTest-1572922141 None] Volume detach called, but volume not attached. Sep 07 02:20:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-94e78242-2f8f-417b-b487-d92620f8dd71 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "cinder-quobyte-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-quobyte-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361" acquired by "delete_volume" :: waited 0.101s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:29 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a537834-645d-4151-a3ef-ef72b8260d3f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:29 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 Sep 07 02:20:29 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:30 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361" returned: 0 in 1.726s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:30 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361 Sep 07 02:20:30 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:32 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361" returned: 0 in 1.500s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-quobyte-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361" released by "delete_volume" :: held 3.412s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:32 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Created reservations ['d0aad1ba-7485-4a98-8936-90f1b5dd1ee8', '06273536-d75c-4c0a-835d-e13035b484e4', 'cfbae3fb-80cc-4622-a9de-ae9dcc4be4f3', '2d5a9ad0-0552-4017-bf3f-b1cccaa7859f'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:33 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:33 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:34 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 1.304s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:34 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Deleted volume successfully. Sep 07 02:20:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a064ef06-39c7-4f17-a217-e03ed96286d0 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-eb1bd7fa-8db4-4d8e-89ea-82046fcaa361-delete_volume" released by "delete_volume" :: held 5.819s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:36 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990" returned: 0 in 9.146s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:36 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399, size 1024.00 MB, duration 9.15 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:20:36 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Converted 1024.00 MB image at 111.95 MB/s Sep 07 02:20:36 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990 is being set with open permissions: ugo+rw Sep 07 02:20:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:36 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990 Sep 07 02:20:36 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:36 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990" returned: 0 in 0.331s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-b2101f5a-c5b5-42be-81f2-c279c011e990" released by "_copy_volume_from_snapshot" :: held 11.142s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-918229fb-e734-4a31-8536-20453657afc6-b2101f5a-c5b5-42be-81f2-c279c011e990" released by "_create_volume_from_snapshot" :: held 11.248s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.273s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cc816d-9e83-463b-9150-f99c65e8bc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2101f5a-c5b5-42be-81f2-c279c011e990', 'volume_size': 1, 'snapshot_id': '918229fb-e734-4a31-8536-20453657afc6'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d81c897-979b-49a6-818f-cec4191b97d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:36 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Volume volume-b2101f5a-c5b5-42be-81f2-c279c011e990 (b2101f5a-c5b5-42be-81f2-c279c011e990): created successfully Sep 07 02:20:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d81c897-979b-49a6-818f-cec4191b97d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Flow 'volume_create_manager' (2e9ce2a2-f2a2-420c-a17f-a0662ed95f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:37 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a5841b14-70ad-4f31-b9f1-1ceb802fa445 tempest-VolumesSnapshotTestJSON-1472382704 None] Created volume successfully. Sep 07 02:20:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-b2101f5a-c5b5-42be-81f2-c279c011e990-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-b2101f5a-c5b5-42be-81f2-c279c011e990-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-b2101f5a-c5b5-42be-81f2-c279c011e990" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-b2101f5a-c5b5-42be-81f2-c279c011e990" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:37 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4cf73c-3e60-4ba0-bd70-ea5233bc4ef8]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:37 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990 Sep 07 02:20:37 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:38 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990" returned: 0 in 0.370s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:38 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990 Sep 07 02:20:38 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (4d3b6584-5c60-4b62-b0b4-887f23098702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55435e39-1f0e-42a4-9cde-931324ea033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55435e39-1f0e-42a4-9cde-931324ea033b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2105989597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba806d5-d32e-415a-b822-ec3cfa301cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:38Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cb7c2a-7071-4f59-bcd1-85c34295cffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cb7c2a-7071-4f59-bcd1-85c34295cffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac9e138-a00e-403c-b1e1-4f0e914937cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac9e138-a00e-403c-b1e1-4f0e914937cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ba806d5-d32e-415a-b822-ec3cfa301cfa', 'volume_name': 'volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:38 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0299c1ed-810f-4c6d-953d-4c7036b78f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0299c1ed-810f-4c6d-953d-4c7036b78f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1483ab07-199e-47f1-a651-3d3f346c211f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:38 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Volume 2ba806d5-d32e-415a-b822-ec3cfa301cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa', 'volume_size': 1} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2105989597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba806d5-d32e-415a-b822-ec3cfa301cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:38Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Creating volume 2ba806d5-d32e-415a-b822-ec3cfa301cfa {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:20:38 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b2101f5a-c5b5-42be-81f2-c279c011e990" returned: 0 in 0.309s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:38 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa 1073741824 Sep 07 02:20:38 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-b2101f5a-c5b5-42be-81f2-c279c011e990" released by "delete_volume" :: held 0.721s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Created reservations ['694cfff2-6731-4d74-8b81-6a433c3bd75a', '40f1c703-7f2f-4309-b8db-f8b416f1a602', 'b0cfa060-876d-463e-88e1-2598ba4ff4d1', '71ee8d2d-1b6a-426f-bb13-220aea21bb4b'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:38 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:38 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:38 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.253s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Deleted volume successfully. Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3315438c-fd62-44ae-ab05-3cdbb859ca4d tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-b2101f5a-c5b5-42be-81f2-c279c011e990-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:38 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-918229fb-e734-4a31-8536-20453657afc6-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa 1073741824" returned: 0 in 0.449s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-918229fb-e734-4a31-8536-20453657afc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-e23c9f5b-3292-4e29-b60a-2dab55d4f399" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-e23c9f5b-3292-4e29-b60a-2dab55d4f399" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-918229fb-e734-4a31-8536-20453657afc6" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-918229fb-e734-4a31-8536-20453657afc6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Deleting offline snapshot 918229fb-e734-4a31-8536-20453657afc6 of volume e23c9f5b-3292-4e29-b60a-2dab55d4f399 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:20:38 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa Sep 07 02:20:38 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] snapshot_file for this snap is: volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad93d57-fa94-4490-ba53-8f100ea175ae]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:39 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 Sep 07 02:20:39 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:39 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1483ab07-199e-47f1-a651-3d3f346c211f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52cf231-c032-411f-afdd-fbdc7956d42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:39 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Volume volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa (2ba806d5-d32e-415a-b822-ec3cfa301cfa): created successfully Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52cf231-c032-411f-afdd-fbdc7956d42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (4d3b6584-5c60-4b62-b0b4-887f23098702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:39 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-76db3152-533d-413b-90ce-ab6bbeec6741 tempest-VolumesActionsTest-1572922141 None] Created volume successfully. Sep 07 02:20:39 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6" returned: 0 in 0.387s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d45d6f0-5fca-4ed2-8b2b-3da79c341ea0]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:39 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 Sep 07 02:20:39 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Acquiring lock "cinder-2ba806d5-d32e-415a-b822-ec3cfa301cfa-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Lock "cinder-2ba806d5-d32e-415a-b822-ec3cfa301cfa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Acquiring lock "cinder-quobyte-2ba806d5-d32e-415a-b822-ec3cfa301cfa" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Lock "cinder-quobyte-2ba806d5-d32e-415a-b822-ec3cfa301cfa" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[92137dcc-f048-4956-81cc-6496696a9104]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:39 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa Sep 07 02:20:39 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:39 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399" returned: 0 in 0.561s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:39 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 Sep 07 02:20:39 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:40 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa" returned: 0 in 0.369s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:40 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa Sep 07 02:20:40 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:40 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2ba806d5-d32e-415a-b822-ec3cfa301cfa" returned: 0 in 0.273s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:40 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6" returned: 0 in 0.345s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Lock "cinder-quobyte-2ba806d5-d32e-415a-b822-ec3cfa301cfa" released by "delete_volume" :: held 0.707s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:40 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6 Sep 07 02:20:40 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Created reservations ['488fc39f-5828-477c-a4ee-6c2c3b7b96f2', '624c864f-6fc5-4bd8-a5ac-87b893091b0a', '8f59323b-b75a-4df1-bfd9-356ae43ae238', '52bfcfb0-8f53-473c-ad35-9e43eff0edbd'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:40 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:40 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:40 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399.918229fb-e734-4a31-8536-20453657afc6" returned: 0 in 0.260s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-918229fb-e734-4a31-8536-20453657afc6" released by "_delete_snapshot" :: held 1.653s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-e23c9f5b-3292-4e29-b60a-2dab55d4f399" released by "delete_snapshot" :: held 1.686s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Created reservations ['5195f75e-02be-40c9-9723-a93d8ba9d4e1', '4602f995-c7ca-40b8-b8df-c4dd0c3bc7e7', '8ed10999-3982-46b5-ba57-b29b9ec8dba0', 'e796d89c-fbb7-45f2-b453-4c98d8cc6643'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:40 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.259s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Deleted volume successfully. Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e85b6168-fb06-4171-a3c4-4586d51a332e tempest-VolumesActionsTest-1116088043 None] Lock "cinder-2ba806d5-d32e-415a-b822-ec3cfa301cfa-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Delete snapshot completed successfully. Sep 07 02:20:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-075da19a-cc6d-48c1-ba1f-fe5938c2c882 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-918229fb-e734-4a31-8536-20453657afc6-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-e23c9f5b-3292-4e29-b60a-2dab55d4f399-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-e23c9f5b-3292-4e29-b60a-2dab55d4f399-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-e23c9f5b-3292-4e29-b60a-2dab55d4f399" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-e23c9f5b-3292-4e29-b60a-2dab55d4f399" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbc9a2e-a6df-4d10-9e0b-4aeb22cf4795]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (e148b258-2151-4bb9-add2-62e7957194d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d8e737-bfa4-49ca-a9ba-36081e7ece06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d8e737-bfa4-49ca-a9ba-36081e7ece06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-91756877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9f6fa7-46ff-42d9-88cf-9782939753dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:41Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7acbe8a7-053a-4929-9e96-0378e1afe370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7acbe8a7-053a-4929-9e96-0378e1afe370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25402157-dfb6-464d-ae77-c89ed2fb34b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25402157-dfb6-464d-ae77-c89ed2fb34b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9f6fa7-46ff-42d9-88cf-9782939753dc', 'volume_name': 'volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d3a214-eb49-4458-8193-50a898e45227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d3a214-eb49-4458-8193-50a898e45227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8539bd7-d045-43eb-ae04-a6cd94a85a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:41 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Volume 6f9f6fa7-46ff-42d9-88cf-9782939753dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc', 'volume_size': 1} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-91756877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9f6fa7-46ff-42d9-88cf-9782939753dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:41Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Creating volume 6f9f6fa7-46ff-42d9-88cf-9782939753dc {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:41 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 Sep 07 02:20:41 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:20:41 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:41 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc 1073741824 Sep 07 02:20:41 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:41 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399" returned: 0 in 0.599s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:41 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399 Sep 07 02:20:41 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:42 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e23c9f5b-3292-4e29-b60a-2dab55d4f399" returned: 0 in 0.269s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-e23c9f5b-3292-4e29-b60a-2dab55d4f399" released by "delete_volume" :: held 0.978s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:42 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc 1073741824" returned: 0 in 0.768s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Created reservations ['7f18b3ab-331c-4a8d-9b22-d7d2fcb869c6', '189fee05-6311-4a63-ab26-41a101e7331d', 'fdae8448-9b43-443e-b721-ff7229ac568d', '0f3c1e27-ae89-4faf-a51a-f054c1168011'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:42 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc Sep 07 02:20:42 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:42 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:42 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:42 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc" returned: 0 in 0.387s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8539bd7-d045-43eb-ae04-a6cd94a85a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0d9e02-bf91-4d39-91b8-d8e2f701a5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:42 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Volume volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc (6f9f6fa7-46ff-42d9-88cf-9782939753dc): created successfully Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0d9e02-bf91-4d39-91b8-d8e2f701a5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (e148b258-2151-4bb9-add2-62e7957194d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:42 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8c3efd6d-bb9d-45f1-89a7-0995090d7fb9 tempest-VolumesActionsTest-1572922141 None] Created volume successfully. Sep 07 02:20:42 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.382s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:42 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Deleted volume successfully. Sep 07 02:20:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6abef045-d765-4348-a2e5-120cfad808ed tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-e23c9f5b-3292-4e29-b60a-2dab55d4f399-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-f647af57-92b0-4e5b-b985-d3a3db087358-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-f647af57-92b0-4e5b-b985-d3a3db087358-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "cinder-quobyte-f647af57-92b0-4e5b-b985-d3a3db087358" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-f647af57-92b0-4e5b-b985-d3a3db087358" acquired by "delete_volume" :: waited 0.033s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3a337e-f08e-49d4-a444-3349cf30153f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Acquiring lock "cinder-6f9f6fa7-46ff-42d9-88cf-9782939753dc-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:43 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 Sep 07 02:20:43 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-6f9f6fa7-46ff-42d9-88cf-9782939753dc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Acquiring lock "cinder-quobyte-6f9f6fa7-46ff-42d9-88cf-9782939753dc" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-quobyte-6f9f6fa7-46ff-42d9-88cf-9782939753dc" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c570adaa-d67f-4865-918a-a92353c0cf8a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:44 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358" returned: 0 in 0.423s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:44 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc Sep 07 02:20:44 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:44 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358 Sep 07 02:20:44 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:44 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f647af57-92b0-4e5b-b985-d3a3db087358" returned: 0 in 0.288s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-quobyte-f647af57-92b0-4e5b-b985-d3a3db087358" released by "delete_volume" :: held 0.785s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:44 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc" returned: 0 in 0.487s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Created reservations ['df8e46a2-83d2-4a0a-93a2-59eb0abae36a', '098b2713-1ad8-4995-8ba1-ad3f6aafe8de', 'f3d58f0c-3293-47c6-94d1-5af3c875251e', '78deb587-5a1c-4090-a082-3e7b00fe1b91'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:44 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc Sep 07 02:20:44 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:44 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:44 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:44 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6f9f6fa7-46ff-42d9-88cf-9782939753dc" returned: 0 in 0.429s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-quobyte-6f9f6fa7-46ff-42d9-88cf-9782939753dc" released by "delete_volume" :: held 0.980s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Created reservations ['f1503c44-1cc9-45c4-862e-ce3c19fac2a0', 'fe116865-fc96-487c-825b-317f09147406', 'c2e63c51-b48e-4d28-bc93-a3dd45b368f4', 'c732932c-3df0-4922-a7f5-6df8347b63df'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:45 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.518s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:45 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Deleted volume successfully. Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2fb4d53-31e4-4db6-b44d-19a9af898814 tempest-VolumesSnapshotTestJSON-1472382704 None] Lock "cinder-f647af57-92b0-4e5b-b985-d3a3db087358-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:45 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:45 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:45 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.303s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:45 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Deleted volume successfully. Sep 07 02:20:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6c3001f0-8ad5-4880-b402-ad3fd29f9267 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-6f9f6fa7-46ff-42d9-88cf-9782939753dc-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (cf42675a-205f-4dd1-aa0e-5996f7e5c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91120382-ce7b-4d4e-b15c-6b0f80c2a928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91120382-ce7b-4d4e-b15c-6b0f80c2a928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-29445356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153c9895-8128-43e9-9f15-4b060ea6d0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:47Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3942a30e-2e4e-4371-bdce-aa25be261ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3942a30e-2e4e-4371-bdce-aa25be261ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59422b37-0208-4c30-881e-4f52f5e60c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59422b37-0208-4c30-881e-4f52f5e60c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153c9895-8128-43e9-9f15-4b060ea6d0c5', 'volume_name': 'volume-153c9895-8128-43e9-9f15-4b060ea6d0c5', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf50e4e-2b27-48ec-b77a-c82432779373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf50e4e-2b27-48ec-b77a-c82432779373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ee54fd-e91a-4038-b3ee-6f2b03076f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:46 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Volume 153c9895-8128-43e9-9f15-4b060ea6d0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153c9895-8128-43e9-9f15-4b060ea6d0c5', 'volume_size': 1} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-29445356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153c9895-8128-43e9-9f15-4b060ea6d0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:47Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Creating volume 153c9895-8128-43e9-9f15-4b060ea6d0c5 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:20:46 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:20:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:46 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5 1073741824 Sep 07 02:20:46 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:47 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-f9cf3b63-10c3-4b27-9c11-ee7d7179460f tempest-ServerActionsTestOtherA-678111813 None] Terminate volume connection completed successfully. Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-f9cf3b63-10c3-4b27-9c11-ee7d7179460f tempest-ServerActionsTestOtherA-678111813 None] Deleting attachment 980a2a1b-9a61-4893-b4d8-f7ec309e21b8. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:20:47 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "cinder-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5 1073741824" returned: 0 in 0.534s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Lock "cinder-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:47 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5 Sep 07 02:20:47 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "cinder-quobyte-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Lock "cinder-quobyte-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2faafef-d900-46f5-9d92-a73be5797877]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:47 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e Sep 07 02:20:47 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:47 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5" returned: 0 in 0.360s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ee54fd-e91a-4038-b3ee-6f2b03076f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153c9895-8128-43e9-9f15-4b060ea6d0c5', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8583f4af-dd9a-48dd-8342-66d0bc4b219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:47 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Volume volume-153c9895-8128-43e9-9f15-4b060ea6d0c5 (153c9895-8128-43e9-9f15-4b060ea6d0c5): created successfully Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8583f4af-dd9a-48dd-8342-66d0bc4b219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (cf42675a-205f-4dd1-aa0e-5996f7e5c189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:47 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-bd082c2d-806c-4f2d-a591-3073f3557a97 tempest-VolumesActionsTest-1572922141 None] Created volume successfully. Sep 07 02:20:47 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e" returned: 0 in 0.463s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:48 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e Sep 07 02:20:48 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:48 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e" returned: 0 in 0.259s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Lock "cinder-quobyte-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e" released by "delete_volume" :: held 0.769s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG cinder.quota [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Created reservations ['a054c6de-0fb8-4222-bcc3-03d2fe545ee1', '96d1fa2b-1e6b-4760-a8f6-9833e557c19b', '890c0a8a-0119-4836-afdb-aafc0cc9f0ec', 'fd58a92c-c8f0-4abc-8be9-b78ab2ef0fa3'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "cinder-bcbb4357-67bd-45a8-8a73-626a6e53897f-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Lock "cinder-bcbb4357-67bd-45a8-8a73-626a6e53897f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:48 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:48 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "cinder-quobyte-bcbb4357-67bd-45a8-8a73-626a6e53897f" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Lock "cinder-quobyte-bcbb4357-67bd-45a8-8a73-626a6e53897f" acquired by "delete_volume" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb6972b-b2ac-4820-aa27-1b3aa8557c82]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:48 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f Sep 07 02:20:48 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:48 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.371s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG cinder.manager [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:48 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Deleted volume successfully. Sep 07 02:20:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-f28ff0f0-0da2-4cbf-8348-0db62fe9cb63 req-17b9f0c4-af1b-4793-845b-e3aabc1304c8 tempest-ServerActionsTestOtherA-678111813 None] Lock "cinder-b6f30e8a-ea12-41c6-ab5b-3c7bd5b1471e-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:49 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f" returned: 0 in 0.478s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:49 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f Sep 07 02:20:49 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Acquiring lock "cinder-153c9895-8128-43e9-9f15-4b060ea6d0c5-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-153c9895-8128-43e9-9f15-4b060ea6d0c5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Acquiring lock "cinder-quobyte-153c9895-8128-43e9-9f15-4b060ea6d0c5" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-quobyte-153c9895-8128-43e9-9f15-4b060ea6d0c5" acquired by "delete_volume" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b47c51c-0112-4df5-8dfe-685c62f4698c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:49 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5 Sep 07 02:20:49 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:49 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bcbb4357-67bd-45a8-8a73-626a6e53897f" returned: 0 in 0.302s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Lock "cinder-quobyte-bcbb4357-67bd-45a8-8a73-626a6e53897f" released by "delete_volume" :: held 0.831s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Created reservations ['a93f53e3-aef5-4b2c-a49f-089a59300a25', 'de3db4e2-6f8d-4c40-b416-f8e8e16a373c', 'ad4de3b9-c411-4f2f-b6bd-fd64d322fe3c', '2e3613ce-0ec5-409a-9c58-a6cb9859bd68'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:49 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:49 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:49 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5" returned: 0 in 0.479s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:49 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5 Sep 07 02:20:49 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:49 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.420s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:49 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Deleted volume successfully. Sep 07 02:20:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-213d3564-4560-4b25-836d-0c8ea3231ef5 tempest-ServerActionsTestOtherA-678111813 None] Lock "cinder-bcbb4357-67bd-45a8-8a73-626a6e53897f-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:50 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-153c9895-8128-43e9-9f15-4b060ea6d0c5" returned: 0 in 0.465s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-quobyte-153c9895-8128-43e9-9f15-4b060ea6d0c5" released by "delete_volume" :: held 0.998s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Created reservations ['979b1ded-75df-47d8-bafc-e0429ddc867e', 'a2366724-8851-40ea-b33d-a575d12bda2c', '03955759-4c87-4150-86f8-7699f4cef72a', 'a8d43adf-0b41-40f7-9d11-75539d103515'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:50 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:50 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:50 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.324s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Deleted volume successfully. Sep 07 02:20:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2693e3e6-0f53-490f-9f83-c173b8b4e700 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-153c9895-8128-43e9-9f15-4b060ea6d0c5-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (01f46d6c-df4e-44e5-918b-1229019053dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eed964-6c96-4e11-afc8-b323f16eaac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eed964-6c96-4e11-afc8-b323f16eaac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433335417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ffda57-0985-44cd-992f-3c710121d99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:52Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165ee4ac-030e-4acc-998b-063ecfd8a07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165ee4ac-030e-4acc-998b-063ecfd8a07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb90c0c6-ea9e-4b46-b9c9-c879f200142d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb90c0c6-ea9e-4b46-b9c9-c879f200142d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02ffda57-0985-44cd-992f-3c710121d99e', 'volume_name': 'volume-02ffda57-0985-44cd-992f-3c710121d99e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e2abb0-783e-413d-85ca-cb87b7f2390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e2abb0-783e-413d-85ca-cb87b7f2390a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073f3902-63f4-4939-b0b7-e97c9bb452ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:52 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Volume 02ffda57-0985-44cd-992f-3c710121d99e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02ffda57-0985-44cd-992f-3c710121d99e', 'volume_size': 1} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433335417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ffda57-0985-44cd-992f-3c710121d99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:52Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Creating volume 02ffda57-0985-44cd-992f-3c710121d99e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:20:52 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:52 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e 1073741824 Sep 07 02:20:52 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:52 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e 1073741824" returned: 0 in 0.506s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:52 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e Sep 07 02:20:52 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:53 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e" returned: 0 in 0.319s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:20:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073f3902-63f4-4939-b0b7-e97c9bb452ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02ffda57-0985-44cd-992f-3c710121d99e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a58ac8-a92d-4ecd-ad31-5deb637cc29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:53 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Volume volume-02ffda57-0985-44cd-992f-3c710121d99e (02ffda57-0985-44cd-992f-3c710121d99e): created successfully Sep 07 02:20:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a58ac8-a92d-4ecd-ad31-5deb637cc29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (01f46d6c-df4e-44e5-918b-1229019053dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:53 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6fb6a8a5-36d3-4947-891b-e1346255aa64 tempest-VolumesActionsTest-1572922141 None] Created volume successfully. Sep 07 02:20:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Acquiring lock "cinder-02ffda57-0985-44cd-992f-3c710121d99e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-02ffda57-0985-44cd-992f-3c710121d99e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Acquiring lock "cinder-quobyte-02ffda57-0985-44cd-992f-3c710121d99e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-quobyte-02ffda57-0985-44cd-992f-3c710121d99e" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:54 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51c87c7-d593-4fe7-a058-25ef6b4012f5]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:54 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e Sep 07 02:20:54 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:54 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e" returned: 0 in 0.408s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:54 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e Sep 07 02:20:54 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:55 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-02ffda57-0985-44cd-992f-3c710121d99e" returned: 0 in 0.304s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-quobyte-02ffda57-0985-44cd-992f-3c710121d99e" released by "delete_volume" :: held 0.789s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Created reservations ['d30cc97d-7083-4e61-a287-c51e406cbb9b', '6dc45bb7-2bd0-41bc-96a4-d83232d75978', '1e43b04c-2855-4ea4-82eb-c854c49a5863', '9ca18b91-3a59-485f-9ef6-1ec09dd2eec6'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:55 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:20:55 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:55 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.345s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:20:55 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Deleted volume successfully. Sep 07 02:20:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2b37aac2-803d-44eb-aed3-597778f28bd5 tempest-VolumesActionsTest-1116088043 None] Lock "cinder-02ffda57-0985-44cd-992f-3c710121d99e-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (0e9524fd-3655-4d7b-9418-ec15bb2387d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0124c5dd-cdef-4189-aa17-e669b7a0bd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0124c5dd-cdef-4189-aa17-e669b7a0bd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1470935662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36269ed-89fb-45b5-b83b-38e5d428ad73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:56Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a92323-3b6c-422e-bf9c-e32e2c1e83eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a92323-3b6c-422e-bf9c-e32e2c1e83eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1231052a-4d76-4a1a-b06f-cda5bf7e3e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1231052a-4d76-4a1a-b06f-cda5bf7e3e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36269ed-89fb-45b5-b83b-38e5d428ad73', 'volume_name': 'volume-d36269ed-89fb-45b5-b83b-38e5d428ad73', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c326f615-e246-47d7-af8e-5cd1bc37ac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c326f615-e246-47d7-af8e-5cd1bc37ac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f676f7-6b89-4236-b2c6-a014601aef73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:56 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Volume d36269ed-89fb-45b5-b83b-38e5d428ad73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36269ed-89fb-45b5-b83b-38e5d428ad73', 'volume_size': 1} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1470935662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36269ed-89fb-45b5-b83b-38e5d428ad73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa96bb8a00c4d0eb3650523e192c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:20:56Z,use_quota=True,user_id='2031c55f142f4893b0e3f05e1f24bb36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Creating volume d36269ed-89fb-45b5-b83b-38e5d428ad73 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:20:56 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:56 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73 1073741824 Sep 07 02:20:56 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:56 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73 1073741824" returned: 0 in 0.443s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:56 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73 Sep 07 02:20:56 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:57 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73" returned: 0 in 0.345s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:20:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:20:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f676f7-6b89-4236-b2c6-a014601aef73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36269ed-89fb-45b5-b83b-38e5d428ad73', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283b4422-2c51-4fbe-baaa-1fc9fe1a7ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:20:57 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Volume volume-d36269ed-89fb-45b5-b83b-38e5d428ad73 (d36269ed-89fb-45b5-b83b-38e5d428ad73): created successfully Sep 07 02:20:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283b4422-2c51-4fbe-baaa-1fc9fe1a7ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:20:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Flow 'volume_create_manager' (0e9524fd-3655-4d7b-9418-ec15bb2387d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:20:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6d37ed7e-c943-48f0-803c-aedd5200378d tempest-VolumesActionsTest-1572922141 None] Created volume successfully. Sep 07 02:20:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-fa6cb5da-fc8c-4eb7-a9bd-334c13766cf4 req-43a01986-34e0-4c75-8dfa-93db91a9cca2 tempest-AttachVolumeTestJSON-1145787406 None] Terminate volume connection completed successfully. Sep 07 02:20:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-fa6cb5da-fc8c-4eb7-a9bd-334c13766cf4 req-43a01986-34e0-4c75-8dfa-93db91a9cca2 tempest-AttachVolumeTestJSON-1145787406 None] Deleting attachment 6a7d1fb3-ebfd-453f-88b6-a620a21ea1f8. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:20:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "cinder-d36269ed-89fb-45b5-b83b-38e5d428ad73-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-d36269ed-89fb-45b5-b83b-38e5d428ad73-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "cinder-quobyte-d36269ed-89fb-45b5-b83b-38e5d428ad73" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:20:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-quobyte-d36269ed-89fb-45b5-b83b-38e5d428ad73" acquired by "delete_volume" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:20:59 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee701df4-a40d-4232-904f-733b8279cbfb]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:20:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:59 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73 Sep 07 02:20:59 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:20:59 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 07 02:20:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73" returned: 0 in 0.432s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:20:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:20:59 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73 Sep 07 02:20:59 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:00 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d36269ed-89fb-45b5-b83b-38e5d428ad73" returned: 0 in 0.297s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-quobyte-d36269ed-89fb-45b5-b83b-38e5d428ad73" released by "delete_volume" :: held 0.794s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Created reservations ['8418ba6f-c58b-4768-9b7e-b5d540740387', '473d8cee-eed0-48eb-a8ca-1fedc3358d26', 'c3643d44-15e8-4301-b852-2f16829a04d7', 'b92a2de8-98f0-4b31-ae61-5f2a9afb5192'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:00 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:21:00 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:00 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.434s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:21:00 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Deleted volume successfully. Sep 07 02:21:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4e46bf3d-912a-4189-81bd-1b4af84db894 tempest-VolumesActionsTest-1572922141 None] Lock "cinder-d36269ed-89fb-45b5-b83b-38e5d428ad73-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=154,cinder:INSERT=41,cinder:SELECT=121,cinder:DELETE=14 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Flow 'volume_create_manager' (082bd03a-b52d-4896-87a2-2d1d28931491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a352696b-3d2c-449e-87f0-a96be87e2410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a352696b-3d2c-449e-87f0-a96be87e2410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-89580344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f263b8-e3a6-4727-8f00-ba9860a89a6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8c9d8503a2c4b9b81950a09968ba1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:03Z,use_quota=True,user_id='511b65223f0e442faa8843a80653c8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d497f5-b993-4916-9f81-d7e03331db14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d497f5-b993-4916-9f81-d7e03331db14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e191749b-6275-473a-8212-86be736ddb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e191749b-6275-473a-8212-86be736ddb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f263b8-e3a6-4727-8f00-ba9860a89a6d', 'volume_name': 'volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd8467d-e706-4df8-b8c9-86f6ecd91f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd8467d-e706-4df8-b8c9-86f6ecd91f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9d2274-601d-461e-a05a-5fac2eec1d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:02 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Volume 40f263b8-e3a6-4727-8f00-ba9860a89a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d', 'volume_size': 1} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-89580344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f263b8-e3a6-4727-8f00-ba9860a89a6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8c9d8503a2c4b9b81950a09968ba1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:03Z,use_quota=True,user_id='511b65223f0e442faa8843a80653c8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Creating volume 40f263b8-e3a6-4727-8f00-ba9860a89a6d {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:21:02 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:21:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:02 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d 1073741824 Sep 07 02:21:02 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:03 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d 1073741824" returned: 0 in 0.523s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:03 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d Sep 07 02:21:03 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:03 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d" returned: 0 in 0.262s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:21:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9d2274-601d-461e-a05a-5fac2eec1d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdf67ef-b931-4b62-9c7f-a176349c64ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:03 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Volume volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d (40f263b8-e3a6-4727-8f00-ba9860a89a6d): created successfully Sep 07 02:21:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdf67ef-b931-4b62-9c7f-a176349c64ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Flow 'volume_create_manager' (082bd03a-b52d-4896-87a2-2d1d28931491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:03 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-bdd55d70-6a67-49c2-930f-6553000e3516 req-8d1e8de4-13cd-4528-b6bd-5e51f41b03c1 tempest-VolumesGetTestJSON-861147180 None] Created volume successfully. Sep 07 02:21:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Acquiring lock "cinder-40f263b8-e3a6-4727-8f00-ba9860a89a6d-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Lock "cinder-40f263b8-e3a6-4727-8f00-ba9860a89a6d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Acquiring lock "cinder-quobyte-40f263b8-e3a6-4727-8f00-ba9860a89a6d" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Lock "cinder-quobyte-40f263b8-e3a6-4727-8f00-ba9860a89a6d" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:04 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82aceaf-ee9a-4407-9bda-0edec6d1af5a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:04 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d Sep 07 02:21:04 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:04 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d" returned: 0 in 0.408s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:04 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d Sep 07 02:21:04 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:04 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-40f263b8-e3a6-4727-8f00-ba9860a89a6d" returned: 0 in 0.275s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Lock "cinder-quobyte-40f263b8-e3a6-4727-8f00-ba9860a89a6d" released by "delete_volume" :: held 0.734s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:04 devstack cinder-volume[87313]: DEBUG cinder.quota [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Created reservations ['54f0ff2e-77cf-46e3-bb5d-e94259407dc9', 'fbf9509c-0e7c-435c-b46a-5a6b6367933c', '428f5383-02d9-4efc-80be-9dc95f045a3a', '4278b6b0-b095-467c-bffe-0db04c2ed744'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:21:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:05 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:21:05 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:05 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.323s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:05 devstack cinder-volume[87313]: DEBUG cinder.manager [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:21:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Deleted volume successfully. Sep 07 02:21:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-4ddc55ec-b0ca-45b4-a666-056b7ea1401c req-0a1fa5e7-4705-4166-ba5e-53357d9664e2 tempest-VolumesGetTestJSON-861147180 None] Lock "cinder-40f263b8-e3a6-4727-8f00-ba9860a89a6d-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:15 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=94,cinder:INSERT=29,cinder:UPDATE=122,cinder:DELETE=7 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:21:15 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=2,cinder:SELECT=3 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:21:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c3f8dbf7-318b-44dd-8132-32f49ec68263 tempest-BackendsCapabilitiesAdminTestsJSON-117483589 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6277351379395, 'free_capacity_gb': 1773.6277351379395, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87313) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 02:21:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c69a6027-1c4c-4b97-b3d2-725b713228ea tempest-BackendsCapabilitiesAdminTestsJSON-117483589 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6277351379395, 'free_capacity_gb': 1773.6277351379395, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87313) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 02:21:25 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:21:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Flow 'volume_create_manager' (ca3e6bec-f351-4584-80d0-2f2f53852f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2026efbe-1338-4285-bd88-7d440ace05ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2026efbe-1338-4285-bd88-7d440ace05ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2087611839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7369cf-ec7a-4677-8e0f-5963e48a6a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768c0906294845fea8907f49d6a5c430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:25Z,use_quota=True,user_id='d850d07a90034e22b2800540d0be18c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18351efd-1d3c-41d7-a84c-ad17ee633b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18351efd-1d3c-41d7-a84c-ad17ee633b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c53239-fe8e-4ae4-b951-b43b2dabef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:25 devstack cinder-volume[87313]: DEBUG cinder.image.glance [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Creating Keystone auth plugin from conf {{(pid=87313) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c53239-fe8e-4ae4-b951-b43b2dabef8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd7369cf-ec7a-4677-8e0f-5963e48a6a56', 'volume_name': 'volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb17ab92-2341-4367-b788-d7191e2803d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb17ab92-2341-4367-b788-d7191e2803d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd41b1c5-fde9-4a68-9744-906a6f00e362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:26 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Volume cd7369cf-ec7a-4677-8e0f-5963e48a6a56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Trying to clone cd7369cf-ec7a-4677-8e0f-5963e48a6a56 from image 923d33a7-8f5b-413a-bd44-620eb1f09c8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]). {{(pid=87313) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:26 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:21:26 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 02:21:26 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Image download 20.69 MB at 20.69 MB/s Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f057635-a80f-4ecb-a5ec-07851b5209c5]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:26 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.468s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:21:26 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD Sep 07 02:21:26 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:26 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:26 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Temporary image 923d33a7-8f5b-413a-bd44-620eb1f09c8b is fetched for user d850d07a90034e22b2800540d0be18c2. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2aea2f-907d-4e25-8f63-a74b773d73c9]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:27 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD Sep 07 02:21:27 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Flow 'volume_create_manager' (ceb8ed75-c92f-452b-8552-4d80354fdddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b538b334-4b93-46ab-bf6b-ca8f23ff929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b538b334-4b93-46ab-bf6b-ca8f23ff929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1287043251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03e2ef3-63b7-4596-bd88-d5d062138f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e92121114e4f449ad8b00a76a79817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:27Z,use_quota=True,user_id='4964f41cac8946ceb8ec80475c8ac83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(163b27ff-bf3d-4ec0-827e-a2e18302a721),volume_type_id=163b27ff-bf3d-4ec0-827e-a2e18302a721)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029b62fb-dea1-4fd4-95dc-1de31b7c17c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029b62fb-dea1-4fd4-95dc-1de31b7c17c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabb10ac-c2e3-4847-94df-43f30bf10373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabb10ac-c2e3-4847-94df-43f30bf10373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03e2ef3-63b7-4596-bd88-d5d062138f87', 'volume_name': 'volume-f03e2ef3-63b7-4596-bd88-d5d062138f87', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a23258-6001-4872-9ab6-8213fea32a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a23258-6001-4872-9ab6-8213fea32a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4420d08b-6f21-41cf-bd7b-6f69d7f0d657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:27 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Volume f03e2ef3-63b7-4596-bd88-d5d062138f87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03e2ef3-63b7-4596-bd88-d5d062138f87', 'volume_size': 1} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1287043251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03e2ef3-63b7-4596-bd88-d5d062138f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e92121114e4f449ad8b00a76a79817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:27Z,use_quota=True,user_id='4964f41cac8946ceb8ec80475c8ac83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(163b27ff-bf3d-4ec0-827e-a2e18302a721),volume_type_id=163b27ff-bf3d-4ec0-827e-a2e18302a721)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Creating volume f03e2ef3-63b7-4596-bd88-d5d062138f87 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:21:27 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:27 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87 1073741824 Sep 07 02:21:27 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:27 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD" returned: 0 in 0.499s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Flow 'volume_create_manager' (aaae184c-939b-4a75-91e6-63782982a4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29703a7d-1c9e-4a48-b4f4-711c88b198e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ff75a00f-f2a0-4086-9996-177c171625d0 tempest-GroupSnapshotsV319Test-1115147315 None] Group tempest-GroupSnapshotsV319Test-Group-940205442: creating Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29703a7d-1c9e-4a48-b4f4-711c88b198e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-336572825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d2d514-adb2-4f2f-8e1b-11bc12f80c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e92121114e4f449ad8b00a76a79817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:28Z,use_quota=True,user_id='4964f41cac8946ceb8ec80475c8ac83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4a7817d-7ae3-45c4-b48b-698d377c1660),volume_type_id=b4a7817d-7ae3-45c4-b48b-698d377c1660)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b033927a-e0c4-4928-a60e-e97002189bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b033927a-e0c4-4928-a60e-e97002189bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168e541d-b041-412c-a49a-cbd60fc559e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168e541d-b041-412c-a49a-cbd60fc559e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d2d514-adb2-4f2f-8e1b-11bc12f80c23', 'volume_name': 'volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc48c01-1315-419b-81c6-ff8f96f3eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc48c01-1315-419b-81c6-ff8f96f3eaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83258ed7-e38b-4d85-b101-adc5df73d622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:27 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Volume b4d2d514-adb2-4f2f-8e1b-11bc12f80c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23', 'volume_size': 1} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ff75a00f-f2a0-4086-9996-177c171625d0 tempest-GroupSnapshotsV319Test-1115147315 None] Group tempest-GroupSnapshotsV319Test-Group-940205442: created successfully Sep 07 02:21:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ff75a00f-f2a0-4086-9996-177c171625d0 tempest-GroupSnapshotsV319Test-1115147315 None] Create group completed successfully. Sep 07 02:21:27 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87 1073741824" returned: 0 in 0.523s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:28 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87 Sep 07 02:21:28 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:28 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2087611839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7369cf-ec7a-4677-8e0f-5963e48a6a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768c0906294845fea8907f49d6a5c430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:25Z,use_quota=True,user_id='d850d07a90034e22b2800540d0be18c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Creating volume cd7369cf-ec7a-4677-8e0f-5963e48a6a56 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:21:28 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4420d08b-6f21-41cf-bd7b-6f69d7f0d657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03e2ef3-63b7-4596-bd88-d5d062138f87', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:28 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 1073741824 Sep 07 02:21:28 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4499357-13d1-47bc-9f3f-35f5daebfe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:28 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Volume volume-f03e2ef3-63b7-4596-bd88-d5d062138f87 (f03e2ef3-63b7-4596-bd88-d5d062138f87): created successfully Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4499357-13d1-47bc-9f3f-35f5daebfe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Flow 'volume_create_manager' (ceb8ed75-c92f-452b-8552-4d80354fdddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:28 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-32a9b22c-0aad-49f9-8afd-520449637c65 tempest-TestInstancesWithCinderVolumes-674604342 None] Created volume successfully. Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Flow 'volume_create_manager' (b1874541-f510-4e29-a2a3-385e92864c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b440b672-7fe8-46f5-b708-2ea95048d363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b440b672-7fe8-46f5-b708-2ea95048d363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1880306014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc4d19c-b104-4d18-966f-2fc9eacf0609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e92121114e4f449ad8b00a76a79817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:28Z,use_quota=True,user_id='4964f41cac8946ceb8ec80475c8ac83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4296e36f-e97e-44f0-b3ed-bf4fab1f9531),volume_type_id=4296e36f-e97e-44f0-b3ed-bf4fab1f9531)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1510bd11-7e7e-47cd-93eb-506a9b18546d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1510bd11-7e7e-47cd-93eb-506a9b18546d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f33d8d6-1a24-4446-9879-35222ee71e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.image.glance [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Creating Keystone auth plugin from conf {{(pid=87313) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 02:21:28 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 1073741824" returned: 0 in 0.495s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:28 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 Sep 07 02:21:28 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f33d8d6-1a24-4446-9879-35222ee71e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'afc4d19c-b104-4d18-966f-2fc9eacf0609', 'volume_name': 'volume-afc4d19c-b104-4d18-966f-2fc9eacf0609', 'volume_size': 1, 'image_id': 'eb70470a-5be3-4e63-83aa-88884b5a0c45', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb70470a-5be3-4e63-83aa-88884b5a0c45', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1052580519', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6e92121114e4f449ad8b00a76a79817', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb70470a-5be3-4e63-83aa-88884b5a0c45', 'created_at': datetime.datetime(2026, 9, 7, 0, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb70470a-5be3-4e63-83aa-88884b5a0c45/file', 'properties': {}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb5571f-e407-4a2f-8a96-6f7446ed7376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb5571f-e407-4a2f-8a96-6f7446ed7376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455efca7-1fa4-4b74-afcf-23e7bdbeddd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:28 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Volume afc4d19c-b104-4d18-966f-2fc9eacf0609: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-afc4d19c-b104-4d18-966f-2fc9eacf0609', 'volume_size': 1, 'image_id': 'eb70470a-5be3-4e63-83aa-88884b5a0c45', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb70470a-5be3-4e63-83aa-88884b5a0c45', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1052580519', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6e92121114e4f449ad8b00a76a79817', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb70470a-5be3-4e63-83aa-88884b5a0c45', 'created_at': datetime.datetime(2026, 9, 7, 0, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb70470a-5be3-4e63-83aa-88884b5a0c45/file', 'properties': {}}, 'image_service': } Sep 07 02:21:28 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Trying to clone afc4d19c-b104-4d18-966f-2fc9eacf0609 from image eb70470a-5be3-4e63-83aa-88884b5a0c45 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb70470a-5be3-4e63-83aa-88884b5a0c45', 'metadata': {}}]). {{(pid=87313) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 02:21:29 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56" returned: 0 in 0.290s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.240s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-336572825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d2d514-adb2-4f2f-8e1b-11bc12f80c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e92121114e4f449ad8b00a76a79817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:28Z,use_quota=True,user_id='4964f41cac8946ceb8ec80475c8ac83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4a7817d-7ae3-45c4-b48b-698d377c1660),volume_type_id=b4a7817d-7ae3-45c4-b48b-698d377c1660)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Creating volume b4d2d514-adb2-4f2f-8e1b-11bc12f80c23 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:21:29 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:29 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23 1073741824 Sep 07 02:21:29 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Attempting download of 923d33a7-8f5b-413a-bd44-620eb1f09c8b ((None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}])) to volume cd7369cf-ec7a-4677-8e0f-5963e48a6a56. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ac3ee0-1cb1-4737-b390-dee4ee973a5c]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_9_tkgaqh {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Flow 'volume_create_manager' (235f663d-eea6-4ef5-9bc2-c5cb3ab65e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0240950a-a093-47c5-a930-483ad4b9a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0240950a-a093-47c5-a930-483ad4b9a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-515284535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a37c585d-c90a-4709-8be4-dcc912c5741c,host='devstack@QuobyteHD#QuobyteHD',id=78f6bbd7-b0c1-442f-aff4-b7a579468f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e95349ef0841689c67ddaf76656b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:29Z,use_quota=True,user_id='6bd0c4548c8d4503aa635374931f5219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d6ae75f-7149-4d71-b3db-e7260ec2f72b),volume_type_id=8d6ae75f-7149-4d71-b3db-e7260ec2f72b)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c8e437-8b72-4917-8026-88a5c17a7aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c8e437-8b72-4917-8026-88a5c17a7aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:29 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_9_tkgaqh Sep 07 02:21:29 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40bf9db2-c433-4c9a-8867-902eb901c599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40bf9db2-c433-4c9a-8867-902eb901c599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f6bbd7-b0c1-442f-aff4-b7a579468f27', 'volume_name': 'volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9a593d-d755-4ed7-88fa-bb6fa7fbacc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9a593d-d755-4ed7-88fa-bb6fa7fbacc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22a1bd4-0611-4ef7-ad7c-66950c129686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:29 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Volume 78f6bbd7-b0c1-442f-aff4-b7a579468f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27', 'volume_size': 1} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:29 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:29 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23 1073741824" returned: 0 in 0.555s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_9_tkgaqh" returned: 0 in 0.394s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_9_tkgaqh {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:29 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23 Sep 07 02:21:29 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:29 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_9_tkgaqh Sep 07 02:21:29 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:30 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23" returned: 0 in 0.314s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a37c585d-c90a-4709-8be4-dcc912c5741c,created_at=2026-09-07T00:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-515284535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a37c585d-c90a-4709-8be4-dcc912c5741c,host='devstack@QuobyteHD#QuobyteHD',id=78f6bbd7-b0c1-442f-aff4-b7a579468f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e95349ef0841689c67ddaf76656b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:29Z,use_quota=True,user_id='6bd0c4548c8d4503aa635374931f5219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d6ae75f-7149-4d71-b3db-e7260ec2f72b),volume_type_id=8d6ae75f-7149-4d71-b3db-e7260ec2f72b)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Creating volume 78f6bbd7-b0c1-442f-aff4-b7a579468f27 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:21:30 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:30 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_9_tkgaqh" returned: 1 in 0.399s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_9_tkgaqh' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83258ed7-e38b-4d85-b101-adc5df73d622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:30 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 1073741824 Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bb8e87-73df-45a6-ba25-e21786c64040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:30 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a473ff24-c70e-4ef1-8422-8828f212372c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:30 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Volume volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23 (b4d2d514-adb2-4f2f-8e1b-11bc12f80c23): created successfully Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bb8e87-73df-45a6-ba25-e21786c64040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Flow 'volume_create_manager' (aaae184c-939b-4a75-91e6-63782982a4c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:30 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-78f8c5fc-2382-4c77-bf8b-baa9d67bdb2c tempest-TestInstancesWithCinderVolumes-674604342 None] Created volume successfully. Sep 07 02:21:30 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD Sep 07 02:21:30 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:30 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] 923d33a7-8f5b-413a-bd44-620eb1f09c8b was qcow2, converting to qcow2 {{(pid=87313) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:30 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 1073741824" returned: 0 in 0.531s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:30 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 Sep 07 02:21:30 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:30 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 Sep 07 02:21:30 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:30 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27" returned: 0 in 0.341s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:21:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22a1bd4-0611-4ef7-ad7c-66950c129686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece793a2-acbe-4db4-8ca4-cb0d746bc12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:31 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Volume volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 (78f6bbd7-b0c1-442f-aff4-b7a579468f27): created successfully Sep 07 02:21:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece793a2-acbe-4db4-8ca4-cb0d746bc12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Flow 'volume_create_manager' (235f663d-eea6-4ef5-9bc2-c5cb3ab65e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d35531d5-6697-4f3d-976e-80974e324278 tempest-GroupSnapshotsV319Test-1115147315 None] Created volume successfully. Sep 07 02:21:32 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] GroupSnapshot d5469465-c8e9-4704-9819-ead9d77d0a34: creating. Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] Group snapshot d5469465-c8e9-4704-9819-ead9d77d0a34: creating. {{(pid=87313) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] Creating offline snapshot 87c83159-02b2-47e2-b2ce-fce7e0a9996a of volume 78f6bbd7-b0c1-442f-aff4-b7a579468f27 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cfa83f-a0eb-421d-b458-1b50d3a9363b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:32 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 Sep 07 02:21:32 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:32 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56" returned: 0 in 1.835s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_14a9wq7_devstack@QuobyteHD, size 112.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:21:32 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Converted 112.00 MB image at 61.00 MB/s Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:32 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 1G Sep 07 02:21:32 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:32 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27" returned: 0 in 0.383s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:32 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a 1G Sep 07 02:21:32 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:32 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 1G" returned: 0 in 0.328s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Downloaded image 923d33a7-8f5b-413a-bd44-620eb1f09c8b ((None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}])) to volume cd7369cf-ec7a-4677-8e0f-5963e48a6a56 successfully. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Temporary image 923d33a7-8f5b-413a-bd44-620eb1f09c8b for user d850d07a90034e22b2800540d0be18c2 is deleted. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Marking volume cd7369cf-ec7a-4677-8e0f-5963e48a6a56 as bootable. {{(pid=87313) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Copying metadata from image 923d33a7-8f5b-413a-bd44-620eb1f09c8b to cd7369cf-ec7a-4677-8e0f-5963e48a6a56. {{(pid=87313) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Creating volume glance metadata for volume cd7369cf-ec7a-4677-8e0f-5963e48a6a56 backed by image 923d33a7-8f5b-413a-bd44-620eb1f09c8b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87313) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd41b1c5-fde9-4a68-9744-906a6f00e362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe1fac2-a311-45ab-9974-84709d1625ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:32 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Volume volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 (cd7369cf-ec7a-4677-8e0f-5963e48a6a56): created successfully Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe1fac2-a311-45ab-9974-84709d1625ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Flow 'volume_create_manager' (ca3e6bec-f351-4584-80d0-2f2f53852f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:32 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d169dc90-a519-4f62-adfa-9fe508d2a506 tempest-VolumesImageMetadata-454465190 None] Created volume successfully. Sep 07 02:21:32 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a 1G" returned: 0 in 0.423s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:33 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a Sep 07 02:21:33 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD, size 20.69 MB, duration 4.28 sec {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 02:21:33 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Image download 20.69 MB at 4.83 MB/s Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4a04ca-ddd1-4cc8-98fd-052e9ea09211]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:33 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a" returned: 0 in 0.315s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:33 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:33 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD Sep 07 02:21:33 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:33 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a Sep 07 02:21:33 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:33 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Temporary image eb70470a-5be3-4e63-83aa-88884b5a0c45 is fetched for user 4964f41cac8946ceb8ec80475c8ac83a. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 02:21:33 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a" returned: 0 in 0.301s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Acquiring lock "cinder-cd7369cf-ec7a-4677-8e0f-5963e48a6a56-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[252a14ca-6fdb-476b-8874-4d1211914979]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:33 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.info Sep 07 02:21:33 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Lock "cinder-cd7369cf-ec7a-4677-8e0f-5963e48a6a56-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Acquiring lock "cinder-quobyte-cd7369cf-ec7a-4677-8e0f-5963e48a6a56" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Lock "cinder-quobyte-cd7369cf-ec7a-4677-8e0f-5963e48a6a56" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[30905c6e-2ce6-44c5-a5b3-5c76ed230a61]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:33 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD Sep 07 02:21:33 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:33 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 Sep 07 02:21:33 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:33 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.info" returned: 0 in 0.295s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:33 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:21:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:33 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.info Sep 07 02:21:33 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:34 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:34 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56" returned: 0 in 0.412s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:34 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.info" returned: 0 in 0.275s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:34 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56 Sep 07 02:21:34 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.115s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.208s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1880306014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc4d19c-b104-4d18-966f-2fc9eacf0609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e92121114e4f449ad8b00a76a79817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:28Z,use_quota=True,user_id='4964f41cac8946ceb8ec80475c8ac83a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4296e36f-e97e-44f0-b3ed-bf4fab1f9531),volume_type_id=4296e36f-e97e-44f0-b3ed-bf4fab1f9531)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Creating volume afc4d19c-b104-4d18-966f-2fc9eacf0609 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:21:34 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:34 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 1073741824 Sep 07 02:21:34 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3fd0066d-9426-4d3d-8a31-c06b8486e798 tempest-GroupSnapshotsV319Test-1115147315 None] group_snapshot d5469465-c8e9-4704-9819-ead9d77d0a34: created successfully Sep 07 02:21:34 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cd7369cf-ec7a-4677-8e0f-5963e48a6a56" returned: 0 in 0.305s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Lock "cinder-quobyte-cd7369cf-ec7a-4677-8e0f-5963e48a6a56" released by "delete_volume" :: held 0.765s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Created reservations ['0f8e506b-27b2-4ea0-86f3-325aefbe737e', 'bb41d0d2-12fa-47f7-aaa8-9cdf3e5855cb', '02b36e6e-c982-492c-917f-d147192bf215', '8b31ba7d-4716-4294-99ed-e1081368db9d'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:34 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:21:34 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:34 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 1073741824" returned: 0 in 0.640s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:35 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 Sep 07 02:21:35 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:35 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.431s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:35 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:21:35 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Deleted volume successfully. Sep 07 02:21:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d0c2a1d-2dc8-485c-9452-22a3c253062d tempest-VolumesImageMetadata-454465190 None] Lock "cinder-cd7369cf-ec7a-4677-8e0f-5963e48a6a56-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:35 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609" returned: 0 in 0.466s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:21:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:35 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Attempting download of eb70470a-5be3-4e63-83aa-88884b5a0c45 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb70470a-5be3-4e63-83aa-88884b5a0c45', 'metadata': {}}])) to volume afc4d19c-b104-4d18-966f-2fc9eacf0609. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 02:21:35 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f155de-e67a-42ab-a5d9-d03309be3ff7]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb70470a-5be3-4e63-83aa-88884b5a0c45_hslwdywi {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:35 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb70470a-5be3-4e63-83aa-88884b5a0c45_hslwdywi Sep 07 02:21:35 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] group_snapshot d5469465-c8e9-4704-9819-ead9d77d0a34: deleting Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] group_snapshot d5469465-c8e9-4704-9819-ead9d77d0a34: deleting {{(pid=87313) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Acquiring lock "cinder-quobyte-78f6bbd7-b0c1-442f-aff4-b7a579468f27" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Lock "cinder-quobyte-78f6bbd7-b0c1-442f-aff4-b7a579468f27" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Acquiring lock "cinder-quobyte-87c83159-02b2-47e2-b2ce-fce7e0a9996a" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Lock "cinder-quobyte-87c83159-02b2-47e2-b2ce-fce7e0a9996a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Deleting offline snapshot 87c83159-02b2-47e2-b2ce-fce7e0a9996a of volume 78f6bbd7-b0c1-442f-aff4-b7a579468f27 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] snapshot_file for this snap is: volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:21:36 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb70470a-5be3-4e63-83aa-88884b5a0c45_hslwdywi" returned: 0 in 0.598s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb70470a-5be3-4e63-83aa-88884b5a0c45_hslwdywi {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[764b6d98-de6a-42e8-9d3c-acf755f49f1a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:36 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb70470a-5be3-4e63-83aa-88884b5a0c45_hslwdywi Sep 07 02:21:36 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:36 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a Sep 07 02:21:36 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:36 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb70470a-5be3-4e63-83aa-88884b5a0c45_hslwdywi" returned: 1 in 0.476s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb70470a-5be3-4e63-83aa-88884b5a0c45_hslwdywi' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f60362f-888d-4e40-a031-14602a52c493]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:36 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a" returned: 0 in 0.516s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd76b2fc-708c-4522-b7c7-fe86e44070c0]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:36 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD Sep 07 02:21:36 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:37 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 Sep 07 02:21:37 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:37 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:37 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] eb70470a-5be3-4e63-83aa-88884b5a0c45 was qcow2, converting to qcow2 {{(pid=87313) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 02:21:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:37 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 Sep 07 02:21:37 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:37 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27" returned: 0 in 0.481s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:37 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a Sep 07 02:21:37 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:37 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a" returned: 0 in 0.440s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:37 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a Sep 07 02:21:37 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:38 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27.87c83159-02b2-47e2-b2ce-fce7e0a9996a" returned: 0 in 0.251s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Lock "cinder-quobyte-87c83159-02b2-47e2-b2ce-fce7e0a9996a" released by "_delete_snapshot" :: held 1.859s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Lock "cinder-quobyte-78f6bbd7-b0c1-442f-aff4-b7a579468f27" released by "delete_snapshot" :: held 1.886s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:38 devstack cinder-volume[87313]: WARNING cinder.quota [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-111259116 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-111259116, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:21:38 devstack cinder-volume[87313]: WARNING cinder.quota [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-111259116 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-111259116, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:21:38 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] Created reservations ['764f6767-97c4-42ca-94f1-d89914cc2398', '24edef6b-8021-4c93-b459-129c21349f6c', 'f1653e6a-cf06-4fff-ba87-4c1cd4149ed8', '33547c71-4eed-4161-a9f9-979cfe87f29b'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:21:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8d5e25ce-9182-439a-b010-c22fb6731939 tempest-GroupSnapshotsV319Test-1115147315 None] group_snapshot d5469465-c8e9-4704-9819-ead9d77d0a34: deleted successfully Sep 07 02:21:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Acquiring lock "cinder-quobyte-78f6bbd7-b0c1-442f-aff4-b7a579468f27" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Lock "cinder-quobyte-78f6bbd7-b0c1-442f-aff4-b7a579468f27" acquired by "delete_volume" :: waited 0.031s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:38 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[02781609-f16e-4e8e-993d-599f16f4e839]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:39 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 Sep 07 02:21:39 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:39 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27" returned: 0 in 0.474s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:39 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609" returned: 0 in 2.191s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb70470a-5be3-4e63-83aa-88884b5a0c45_dqsuw8eadevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:21:39 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Converted 112.00 MB image at 51.05 MB/s Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:39 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27 Sep 07 02:21:39 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:39 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 1G Sep 07 02:21:39 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:39 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-78f6bbd7-b0c1-442f-aff4-b7a579468f27" returned: 0 in 0.323s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Lock "cinder-quobyte-78f6bbd7-b0c1-442f-aff4-b7a579468f27" released by "delete_volume" :: held 0.888s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Created reservations ['1d509331-e5c5-4c3a-9883-5d0f63229a69'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:21:39 devstack cinder-volume[87313]: WARNING cinder.quota [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-111259116 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-111259116, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Created reservations ['f3c529fe-1e7b-49ee-b059-22010ec4b6c5', '4fa1a7fb-0c4d-4cbe-b489-a543b889f2b0', 'ce43c812-f977-40e6-b621-76c1db083d7a', '8088b900-6653-4f38-aab8-1447d71b6f95'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:21:39 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 1G" returned: 0 in 0.502s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Downloaded image eb70470a-5be3-4e63-83aa-88884b5a0c45 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb70470a-5be3-4e63-83aa-88884b5a0c45', 'metadata': {}}])) to volume afc4d19c-b104-4d18-966f-2fc9eacf0609 successfully. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Temporary image eb70470a-5be3-4e63-83aa-88884b5a0c45 for user 4964f41cac8946ceb8ec80475c8ac83a is deleted. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Marking volume afc4d19c-b104-4d18-966f-2fc9eacf0609 as bootable. {{(pid=87313) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Copying metadata from image eb70470a-5be3-4e63-83aa-88884b5a0c45 to afc4d19c-b104-4d18-966f-2fc9eacf0609. {{(pid=87313) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 02:21:39 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Creating volume glance metadata for volume afc4d19c-b104-4d18-966f-2fc9eacf0609 backed by image eb70470a-5be3-4e63-83aa-88884b5a0c45 with: {'image_id': 'eb70470a-5be3-4e63-83aa-88884b5a0c45', 'image_name': 'tempest-scenario-img--1052580519', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87313) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:40 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:21:40 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455efca7-1fa4-4b74-afcf-23e7bdbeddd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc4d19c-b104-4d18-966f-2fc9eacf0609', 'volume_size': 1, 'image_id': 'eb70470a-5be3-4e63-83aa-88884b5a0c45', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb70470a-5be3-4e63-83aa-88884b5a0c45', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1052580519', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6e92121114e4f449ad8b00a76a79817', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eb70470a-5be3-4e63-83aa-88884b5a0c45', 'created_at': datetime.datetime(2026, 9, 7, 0, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb70470a-5be3-4e63-83aa-88884b5a0c45/file', 'properties': {}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8094590f-4ece-4cd6-87ad-e9dede34dc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:40 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Volume volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 (afc4d19c-b104-4d18-966f-2fc9eacf0609): created successfully Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8094590f-4ece-4cd6-87ad-e9dede34dc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Flow 'volume_create_manager' (b1874541-f510-4e29-a2a3-385e92864c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-05dce090-e8de-4ac2-9274-bc544b7f60af tempest-TestInstancesWithCinderVolumes-674604342 None] Created volume successfully. Sep 07 02:21:40 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.416s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:21:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-41643346-5cf2-40dd-9203-aa4e5216dd7c tempest-GroupSnapshotsV319Test-1115147315 None] Delete group completed successfully. Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Flow 'volume_create_manager' (da779354-91ee-49cf-8df6-d838b7c8953a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1f6e8f-7336-4d94-ac54-3f0bf3dd3887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1f6e8f-7336-4d94-ac54-3f0bf3dd3887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1387336635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3e6194-5c87-46fd-a5a9-921056515dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279cade807224992af9196e4e929a95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:41Z,use_quota=True,user_id='8340355354724e3b917c06eba16007bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8834ab6c-fa6c-4233-af61-6edbfb544e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8834ab6c-fa6c-4233-af61-6edbfb544e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122fbf36-3568-440c-84bf-c4ae87312511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122fbf36-3568-440c-84bf-c4ae87312511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c3e6194-5c87-46fd-a5a9-921056515dc7', 'volume_name': 'volume-8c3e6194-5c87-46fd-a5a9-921056515dc7', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4191624e-7ba2-41e6-824f-2fec7642897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4191624e-7ba2-41e6-824f-2fec7642897c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d784c1ce-39a2-4ee9-8d6b-f4c93143cac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:40 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Volume 8c3e6194-5c87-46fd-a5a9-921056515dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c3e6194-5c87-46fd-a5a9-921056515dc7', 'volume_size': 1} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1387336635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3e6194-5c87-46fd-a5a9-921056515dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279cade807224992af9196e4e929a95e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:21:41Z,use_quota=True,user_id='8340355354724e3b917c06eba16007bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Creating volume 8c3e6194-5c87-46fd-a5a9-921056515dc7 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:21:40 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:21:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:40 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 1073741824 Sep 07 02:21:40 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:41 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 1073741824" returned: 0 in 0.523s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:41 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 Sep 07 02:21:41 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:41 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7" returned: 0 in 0.451s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:21:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d784c1ce-39a2-4ee9-8d6b-f4c93143cac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c3e6194-5c87-46fd-a5a9-921056515dc7', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b970d348-78ab-4369-a613-904b33d60aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:21:41 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Volume volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 (8c3e6194-5c87-46fd-a5a9-921056515dc7): created successfully Sep 07 02:21:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b970d348-78ab-4369-a613-904b33d60aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:21:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Flow 'volume_create_manager' (da779354-91ee-49cf-8df6-d838b7c8953a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:21:41 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1bbca61c-a93e-4d91-ba8e-8ec5e686f4ab tempest-SnapshotMetadataTestJSON-742349780 None] Created volume successfully. Sep 07 02:21:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] Creating offline snapshot 5280e976-9e27-4d3f-9b44-dc8411cbf0bd of volume 8c3e6194-5c87-46fd-a5a9-921056515dc7 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:21:43 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[345ba4c1-689e-4d29-97e3-513f830f4825]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:43 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 Sep 07 02:21:43 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:43 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7" returned: 0 in 0.784s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:43 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd 1G Sep 07 02:21:43 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-63b5146d-1b30-457c-aad2-5c0267506793 req-553565c3-2f19-47b4-abfd-7afa20eb0c1a tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:44 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd 1G" returned: 0 in 0.577s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:44 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd Sep 07 02:21:44 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:44 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd" returned: 0 in 0.514s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:44 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd is being set with open permissions: ugo+rw Sep 07 02:21:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:45 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd Sep 07 02:21:45 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:45 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd" returned: 0 in 0.375s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:45 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.info Sep 07 02:21:45 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:45 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.info" returned: 0 in 0.377s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:45 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.info is being set with open permissions: ugo+rw Sep 07 02:21:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:45 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.info Sep 07 02:21:45 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:46 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.info" returned: 0 in 0.467s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.261s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-63b5146d-1b30-457c-aad2-5c0267506793 req-553565c3-2f19-47b4-abfd-7afa20eb0c1a tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.306s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-63b5146d-1b30-457c-aad2-5c0267506793 req-553565c3-2f19-47b4-abfd-7afa20eb0c1a tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.111s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:46 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-18dfae86-d4f2-48a2-8815-c98b75c62e47 tempest-SnapshotMetadataTestJSON-742349780 None] Create snapshot completed successfully Sep 07 02:21:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-63b5146d-1b30-457c-aad2-5c0267506793 req-553565c3-2f19-47b4-abfd-7afa20eb0c1a tempest-TestInstancesWithCinderVolumes-674604342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-afc4d19c-b104-4d18-966f-2fc9eacf0609', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed761fdd-8129-4061-a06c-176b2c1d3c07', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:21:46 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-63b5146d-1b30-457c-aad2-5c0267506793 req-553565c3-2f19-47b4-abfd-7afa20eb0c1a tempest-TestInstancesWithCinderVolumes-674604342 None] attachment_update completed successfully. Sep 07 02:21:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Acquiring lock "cinder-5280e976-9e27-4d3f-9b44-dc8411cbf0bd-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Lock "cinder-5280e976-9e27-4d3f-9b44-dc8411cbf0bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Acquiring lock "cinder-quobyte-8c3e6194-5c87-46fd-a5a9-921056515dc7" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Lock "cinder-quobyte-8c3e6194-5c87-46fd-a5a9-921056515dc7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Acquiring lock "cinder-quobyte-5280e976-9e27-4d3f-9b44-dc8411cbf0bd" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Lock "cinder-quobyte-5280e976-9e27-4d3f-9b44-dc8411cbf0bd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Deleting offline snapshot 5280e976-9e27-4d3f-9b44-dc8411cbf0bd of volume 8c3e6194-5c87-46fd-a5a9-921056515dc7 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:21:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] snapshot_file for this snap is: volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:21:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d1c11e-4bfc-4d47-bfce-8c7f637dae04]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:49 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd Sep 07 02:21:49 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:50 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd" returned: 0 in 0.968s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c3e6194-5c87-46fd-a5a9-921056515dc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:21:50 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aedaf0-53ea-4002-829d-be81778a0025]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:50 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 Sep 07 02:21:50 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:51 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7" returned: 0 in 0.624s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:51 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd Sep 07 02:21:51 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:52 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd" returned: 0 in 1.117s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:52 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd Sep 07 02:21:52 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:52 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7.5280e976-9e27-4d3f-9b44-dc8411cbf0bd" returned: 0 in 0.564s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Lock "cinder-quobyte-5280e976-9e27-4d3f-9b44-dc8411cbf0bd" released by "_delete_snapshot" :: held 3.522s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Lock "cinder-quobyte-8c3e6194-5c87-46fd-a5a9-921056515dc7" released by "delete_snapshot" :: held 3.559s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:53 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Created reservations ['107f6c71-1fd3-4348-b3b6-7ec19e3d53a6', '8f3eb28e-9c70-4816-b861-1923e616df34', '1558f0da-8c1a-44a1-9fdf-4485f8fcb4aa', 'eedc3d06-cd5c-4a10-a6a3-30fd8da0bd8a'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:21:53 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Delete snapshot completed successfully. Sep 07 02:21:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1ced025b-6822-437f-aacc-4f9b5db2ea2b tempest-SnapshotMetadataTestJSON-742349780 None] Lock "cinder-5280e976-9e27-4d3f-9b44-dc8411cbf0bd-delete_snapshot" released by "delete_snapshot" :: held 3.895s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Acquiring lock "cinder-8c3e6194-5c87-46fd-a5a9-921056515dc7-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Lock "cinder-8c3e6194-5c87-46fd-a5a9-921056515dc7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Acquiring lock "cinder-quobyte-8c3e6194-5c87-46fd-a5a9-921056515dc7" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:21:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Lock "cinder-quobyte-8c3e6194-5c87-46fd-a5a9-921056515dc7" acquired by "delete_volume" :: waited 0.036s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:21:54 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a599fda2-e23f-44ef-bef4-6d2bfe225495]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:21:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:54 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 Sep 07 02:21:54 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:54 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7" returned: 0 in 0.650s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:55 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7 Sep 07 02:21:55 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:55 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8c3e6194-5c87-46fd-a5a9-921056515dc7" returned: 0 in 0.593s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Lock "cinder-quobyte-8c3e6194-5c87-46fd-a5a9-921056515dc7" released by "delete_volume" :: held 1.365s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:21:55 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Created reservations ['9d15284b-c8e0-4f21-a111-3ca10a63032a', '88ff631c-51a8-48ab-8d83-3f49316afa19', 'e9c3212e-1e47-42e1-904b-15490d66f23b', '4970476a-a799-4d3c-b63a-63549d507040'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:21:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:21:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:21:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:21:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:21:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:21:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:21:55 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:21:55 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:21:56 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Sep 07 02:21:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.625s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:21:56 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:21:56 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Deleted volume successfully. Sep 07 02:21:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7914ca92-d958-4ef5-b127-f0cb5ef2ad99 tempest-SnapshotMetadataTestJSON-742349780 None] Lock "cinder-8c3e6194-5c87-46fd-a5a9-921056515dc7-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:05 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=70,cinder:INSERT=25,cinder:UPDATE=69,cinder:DELETE=4 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:22:05 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (d601277b-1237-4bb1-a0c1-f65ea5dff581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516563a5-0265-4112-a236-d648e7a45b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516563a5-0265-4112-a236-d648e7a45b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1566512977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ff4eb6-35ef-4cc5-9274-4e8321345e4a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:06Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcf55ab-f3ef-4d2c-b4c7-a6c1199b90d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcf55ab-f3ef-4d2c-b4c7-a6c1199b90d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff464c01-6e4b-44ea-ac17-6db3fa259fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff464c01-6e4b-44ea-ac17-6db3fa259fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ff4eb6-35ef-4cc5-9274-4e8321345e4a', 'volume_name': 'volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88872b9c-3dfd-49e2-acfb-228e54a0ac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88872b9c-3dfd-49e2-acfb-228e54a0ac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d60788-9008-4ad5-80f3-635fa883a1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:06 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Volume 52ff4eb6-35ef-4cc5-9274-4e8321345e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a', 'volume_size': 1} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1566512977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ff4eb6-35ef-4cc5-9274-4e8321345e4a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:06Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Creating volume 52ff4eb6-35ef-4cc5-9274-4e8321345e4a {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:22:06 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:06 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a 1073741824 Sep 07 02:22:06 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:06 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a 1073741824" returned: 0 in 0.881s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:07 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a Sep 07 02:22:07 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:07 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a" returned: 0 in 0.362s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:22:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d60788-9008-4ad5-80f3-635fa883a1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd066294-e10a-401e-9a19-4c0d5cd38657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:07 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Volume volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a (52ff4eb6-35ef-4cc5-9274-4e8321345e4a): created successfully Sep 07 02:22:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd066294-e10a-401e-9a19-4c0d5cd38657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (d601277b-1237-4bb1-a0c1-f65ea5dff581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:07 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ade8d058-adf8-4622-a093-fd0372d7ec8f tempest-VolumesGetTest-1558026568 None] Created volume successfully. Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (bc5be633-bebe-4692-bfbb-1591396569c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d1600e-39b8-4221-9bc7-e75ef54454e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d1600e-39b8-4221-9bc7-e75ef54454e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1792999932',display_name='tempest-VolumesGetTest-Volume-500639655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8929ef2a-b605-409a-9239-92671ed9c77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:10Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4895af14-a7a3-4108-82cb-5827ef156362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4895af14-a7a3-4108-82cb-5827ef156362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdc99f9-3c1e-4962-8284-987dd511719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdc99f9-3c1e-4962-8284-987dd511719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8929ef2a-b605-409a-9239-92671ed9c77c', 'volume_name': 'volume-8929ef2a-b605-409a-9239-92671ed9c77c', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9138544a-32d8-4752-a8e0-c1e15b265fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9138544a-32d8-4752-a8e0-c1e15b265fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192474eb-fb06-4d94-8b6f-4d28fddebfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:09 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Volume 8929ef2a-b605-409a-9239-92671ed9c77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8929ef2a-b605-409a-9239-92671ed9c77c', 'volume_size': 1} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1792999932',display_name='tempest-VolumesGetTest-Volume-500639655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8929ef2a-b605-409a-9239-92671ed9c77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:10Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Creating volume 8929ef2a-b605-409a-9239-92671ed9c77c {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:22:09 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:22:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:10 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c 1073741824 Sep 07 02:22:10 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:10 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c 1073741824" returned: 0 in 0.594s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:10 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c Sep 07 02:22:10 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:10 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c" returned: 0 in 0.301s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:22:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192474eb-fb06-4d94-8b6f-4d28fddebfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8929ef2a-b605-409a-9239-92671ed9c77c', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeded58f-5156-4e7b-a061-e5dc48dc5858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:10 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Volume volume-8929ef2a-b605-409a-9239-92671ed9c77c (8929ef2a-b605-409a-9239-92671ed9c77c): created successfully Sep 07 02:22:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeded58f-5156-4e7b-a061-e5dc48dc5858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (bc5be633-bebe-4692-bfbb-1591396569c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-62d5f921-e488-4843-8fe4-a5b2dda001dd tempest-VolumesGetTest-1558026568 None] Created volume successfully. Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-8929ef2a-b605-409a-9239-92671ed9c77c-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Lock "cinder-8929ef2a-b605-409a-9239-92671ed9c77c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-quobyte-8929ef2a-b605-409a-9239-92671ed9c77c" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-8929ef2a-b605-409a-9239-92671ed9c77c" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b78763-2193-4288-8f64-5559856547bc]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:12 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c Sep 07 02:22:12 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:12 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c" returned: 0 in 0.377s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:12 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c Sep 07 02:22:12 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:12 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8929ef2a-b605-409a-9239-92671ed9c77c" returned: 0 in 0.250s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-8929ef2a-b605-409a-9239-92671ed9c77c" released by "delete_volume" :: held 0.668s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Created reservations ['9f0d34cb-5979-4b98-abf6-a2ea163aa3d4', '1bc4ae9e-a919-4ab2-a82d-b51f6573c0c8', '8864a03a-fbe9-495d-a46f-10d7556d45c0', '4268f3f1-ac53-45ad-a596-c24dd6647724'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:12 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:12 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:13 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.282s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:13 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Deleted volume successfully. Sep 07 02:22:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a85a51ce-ecac-460a-8b39-8a109128c858 tempest-VolumesGetTest-1558026568 None] Lock "cinder-8929ef2a-b605-409a-9239-92671ed9c77c-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-52ff4eb6-35ef-4cc5-9274-4e8321345e4a-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Lock "cinder-52ff4eb6-35ef-4cc5-9274-4e8321345e4a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-quobyte-52ff4eb6-35ef-4cc5-9274-4e8321345e4a" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-52ff4eb6-35ef-4cc5-9274-4e8321345e4a" acquired by "delete_volume" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:13 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[369c2173-6b58-4b8e-92c2-35ebe1fcfc46]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:13 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a Sep 07 02:22:13 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:13 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a" returned: 0 in 0.379s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:13 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a Sep 07 02:22:13 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:14 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-52ff4eb6-35ef-4cc5-9274-4e8321345e4a" returned: 0 in 0.290s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-52ff4eb6-35ef-4cc5-9274-4e8321345e4a" released by "delete_volume" :: held 0.717s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Created reservations ['40a11aac-ec8f-4063-b8de-dbe7fbca1cd6', '70e7a2a0-f7df-4c85-9995-adee88a6d844', 'b22b2ea4-4f6e-4598-ab90-136345f6983f', 'bbeea61c-d916-4b69-a0ed-8ffb4de794fb'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:14 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:14 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:14 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.366s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:14 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Deleted volume successfully. Sep 07 02:22:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fc4fa5fd-25e6-4bcb-b5f8-09e260aba0ed tempest-VolumesGetTest-1558026568 None] Lock "cinder-52ff4eb6-35ef-4cc5-9274-4e8321345e4a-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (6bd7d685-1fe5-4173-84f5-5b0e82125f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0dc7a5-21f0-4f18-8baf-199feec190b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0dc7a5-21f0-4f18-8baf-199feec190b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-785167375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1cf763-3087-4334-8089-22567bf1ff25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:15Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a555b0-e4e4-45db-af9a-ff3c2d1d61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a555b0-e4e4-45db-af9a-ff3c2d1d61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dce6579-ab03-41f7-b0d0-bfa870627219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dce6579-ab03-41f7-b0d0-bfa870627219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1cf763-3087-4334-8089-22567bf1ff25', 'volume_name': 'volume-4c1cf763-3087-4334-8089-22567bf1ff25', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfabc500-9471-417f-84bc-2d04a2751940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfabc500-9471-417f-84bc-2d04a2751940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887de32d-ef8e-42db-9ef3-aab5b33ebc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:15 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Volume 4c1cf763-3087-4334-8089-22567bf1ff25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1cf763-3087-4334-8089-22567bf1ff25', 'volume_size': 1} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-785167375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1cf763-3087-4334-8089-22567bf1ff25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:15Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Creating volume 4c1cf763-3087-4334-8089-22567bf1ff25 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:22:15 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:15 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 1073741824 Sep 07 02:22:15 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:15 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 1073741824" returned: 0 in 0.534s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:15 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 Sep 07 02:22:15 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:16 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25" returned: 0 in 0.298s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:22:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887de32d-ef8e-42db-9ef3-aab5b33ebc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1cf763-3087-4334-8089-22567bf1ff25', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dff22f6-40f9-492a-b127-68c3b756f431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:16 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Volume volume-4c1cf763-3087-4334-8089-22567bf1ff25 (4c1cf763-3087-4334-8089-22567bf1ff25): created successfully Sep 07 02:22:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dff22f6-40f9-492a-b127-68c3b756f431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (6bd7d685-1fe5-4173-84f5-5b0e82125f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:16 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-aeb0cc2f-97a5-4070-905b-e49fa716a405 tempest-VolumesGetTest-1558026568 None] Created volume successfully. Sep 07 02:22:17 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (8df110be-5995-46ea-a7b7-d3c1b65116b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3eb839-35a4-4b89-8982-182af8f07150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3eb839-35a4-4b89-8982-182af8f07150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-704383324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a625f9-16f4-47a1-aeb6-a293803577b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4c1cf763-3087-4334-8089-22567bf1ff25,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:18Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6107f956-01f3-4db0-b4b2-a7b602f80827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6107f956-01f3-4db0-b4b2-a7b602f80827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a07ac4-02da-44ca-a29e-5777303e410b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a07ac4-02da-44ca-a29e-5777303e410b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '75a625f9-16f4-47a1-aeb6-a293803577b1', 'volume_name': 'volume-75a625f9-16f4-47a1-aeb6-a293803577b1', 'volume_size': 1, 'source_volid': '4c1cf763-3087-4334-8089-22567bf1ff25', 'source_volstatus': 'available'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31d559a-9015-4242-8422-46b8a0ba2ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31d559a-9015-4242-8422-46b8a0ba2ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de13075-333f-4f1e-a94f-24bd58052fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:18 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Volume 75a625f9-16f4-47a1-aeb6-a293803577b1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-75a625f9-16f4-47a1-aeb6-a293803577b1', 'volume_size': 1, 'source_volid': '4c1cf763-3087-4334-8089-22567bf1ff25', 'source_volstatus': 'available'} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:18 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Cloning volume 4c1cf763-3087-4334-8089-22567bf1ff25 to volume 75a625f9-16f4-47a1-aeb6-a293803577b1 Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Creating offline snapshot 07aab899-6e5d-404c-bd43-bd42638ad635 of volume 4c1cf763-3087-4334-8089-22567bf1ff25 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae7bdad-768e-46bc-a0e2-ff757422fc05]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:18 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 Sep 07 02:22:18 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:18 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25" returned: 0 in 0.559s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:18 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 1G Sep 07 02:22:18 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Flow 'volume_create_manager' (c099fcab-98d9-46ed-984c-b58c3d05b95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45a3054-8709-4f4a-b027-8286eda99f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45a3054-8709-4f4a-b027-8286eda99f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1035992043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a523a306edb4c81889e2f6b861c3c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:19Z,use_quota=True,user_id='dae831d0ce3b4fc188d00ca8a192a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ab920d-81af-47ec-a201-b0082742ada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ab920d-81af-47ec-a201-b0082742ada9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e442e2e5-7b1e-4cc8-ad3e-398396a5b47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e442e2e5-7b1e-4cc8-ad3e-398396a5b47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc', 'volume_name': 'volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfd0cc4-fe32-4ae2-ad85-7874ee148b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfd0cc4-fe32-4ae2-ad85-7874ee148b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca496697-886b-4abd-bebd-b4bf5a7897c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:19 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Volume 871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc', 'volume_size': 1} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:19 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 1G" returned: 0 in 0.502s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c1cf763-3087-4334-8089-22567bf1ff25 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:19 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c1cf763-3087-4334-8089-22567bf1ff25 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 Sep 07 02:22:19 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:19 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c1cf763-3087-4334-8089-22567bf1ff25 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635" returned: 0 in 0.323s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:19 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 is being set with open permissions: ugo+rw Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:19 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 Sep 07 02:22:19 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:19 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635" returned: 0 in 0.286s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:19 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.info Sep 07 02:22:19 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:20 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.info" returned: 0 in 0.288s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:20 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.info is being set with open permissions: ugo+rw Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:20 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.info Sep 07 02:22:20 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:20 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.info" returned: 0 in 0.263s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-quobyte-75a625f9-16f4-47a1-aeb6-a293803577b1" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-75a625f9-16f4-47a1-aeb6-a293803577b1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] snapshot: 07aab899-6e5d-404c-bd43-bd42638ad635, volume: 75a625f9-16f4-47a1-aeb6-a293803577b1, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b1134d-b1d5-4ce4-9319-e81c0398f7f5]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:20 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 Sep 07 02:22:20 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:20 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635" returned: 0 in 0.380s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c1cf763-3087-4334-8089-22567bf1ff25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[da968cab-c573-4a34-b913-126ac134ad5d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:21 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 Sep 07 02:22:21 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:21 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25" returned: 0 in 0.397s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:22:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:22:21 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1 not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:22:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:21 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1 Sep 07 02:22:21 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:26 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:26 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:26 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1" returned: 0 in 5.265s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:22:26 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Converted 1024.00 MB image at 194.43 MB/s Sep 07 02:22:26 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1 is being set with open permissions: ugo+rw Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:26 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1 Sep 07 02:22:26 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:26 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.617s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:22:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:22:26 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1" returned: 0 in 0.369s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-75a625f9-16f4-47a1-aeb6-a293803577b1" released by "_copy_volume_from_snapshot" :: held 6.481s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-quobyte-07aab899-6e5d-404c-bd43-bd42638ad635" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-07aab899-6e5d-404c-bd43-bd42638ad635" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Deleting offline snapshot 07aab899-6e5d-404c-bd43-bd42638ad635 of volume 4c1cf763-3087-4334-8089-22567bf1ff25 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] snapshot_file for this snap is: volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3da9b8-3a4c-46cf-96ef-eddc980e53fb]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:27 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 Sep 07 02:22:27 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=87,cinder:SELECT=102,cinder:INSERT=33,cinder:DELETE=8 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-df474336-7bc8-47b4-bfed-ccc503a5cdde req-3a0e5334-be89-46ee-adc6-16fb96e0295b tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:27 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635" returned: 0 in 0.407s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c1cf763-3087-4334-8089-22567bf1ff25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[52675d9b-e8cf-4e6e-98d5-75fead44821b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:27 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 Sep 07 02:22:27 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Flow 'volume_create_manager' (f2cf4754-555f-4e75-a4fe-fd4dc88433ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fae91d-b7a5-4a4f-8ea8-1c948e5f3730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fae91d-b7a5-4a4f-8ea8-1c948e5f3730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1708067999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735a6414-e2b9-44f6-b39a-d0108bdc13d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1598421ca8c4baebc04aa1afdddcd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:28Z,use_quota=True,user_id='f530bb687995436e9c949f04bbd70490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228bcfd5-1522-49e6-a560-a40ad6e7b902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228bcfd5-1522-49e6-a560-a40ad6e7b902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5312316-d5dc-47ea-a758-9f90b0dcd1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5312316-d5dc-47ea-a758-9f90b0dcd1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735a6414-e2b9-44f6-b39a-d0108bdc13d8', 'volume_name': 'volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:28 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a79e74e-a7ec-41c9-a595-d14b7185c28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a79e74e-a7ec-41c9-a595-d14b7185c28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dee12c0-ccfe-4bdd-81fb-a110619fc0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:28 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Volume 735a6414-e2b9-44f6-b39a-d0108bdc13d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8', 'volume_size': 1} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25" returned: 0 in 0.565s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:28 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 Sep 07 02:22:28 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:28 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635" returned: 0 in 0.324s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:28 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635 Sep 07 02:22:28 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:28 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25.07aab899-6e5d-404c-bd43-bd42638ad635" returned: 0 in 0.244s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-07aab899-6e5d-404c-bd43-bd42638ad635" released by "_delete_snapshot" :: held 1.634s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.593s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.622s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1035992043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a523a306edb4c81889e2f6b861c3c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:19Z,use_quota=True,user_id='dae831d0ce3b4fc188d00ca8a192a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Creating volume 871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:22:28 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:28 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc 1073741824 Sep 07 02:22:28 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de13075-333f-4f1e-a94f-24bd58052fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a625f9-16f4-47a1-aeb6-a293803577b1', 'volume_size': 1, 'source_volid': '4c1cf763-3087-4334-8089-22567bf1ff25', 'source_volstatus': 'available'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47432610-ef23-4ef9-bf57-f96d0efdc84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:28 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Volume volume-75a625f9-16f4-47a1-aeb6-a293803577b1 (75a625f9-16f4-47a1-aeb6-a293803577b1): created successfully Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47432610-ef23-4ef9-bf57-f96d0efdc84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (8df110be-5995-46ea-a7b7-d3c1b65116b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:28 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-bca8fbce-c628-408c-b7f1-a31098c4be5d tempest-VolumesGetTest-1558026568 None] Created volume successfully. Sep 07 02:22:29 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc 1073741824" returned: 0 in 0.413s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:29 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc Sep 07 02:22:29 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:29 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc" returned: 0 in 0.270s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-df474336-7bc8-47b4-bfed-ccc503a5cdde req-3a0e5334-be89-46ee-adc6-16fb96e0295b tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.063s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca496697-886b-4abd-bebd-b4bf5a7897c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be96a8c6-5189-4736-b991-647b79e7e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-df474336-7bc8-47b4-bfed-ccc503a5cdde req-3a0e5334-be89-46ee-adc6-16fb96e0295b tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1708067999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735a6414-e2b9-44f6-b39a-d0108bdc13d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1598421ca8c4baebc04aa1afdddcd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:28Z,use_quota=True,user_id='f530bb687995436e9c949f04bbd70490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Creating volume 735a6414-e2b9-44f6-b39a-d0108bdc13d8 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:22:29 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:29 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Volume volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc (871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc): created successfully Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be96a8c6-5189-4736-b991-647b79e7e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Flow 'volume_create_manager' (c099fcab-98d9-46ed-984c-b58c3d05b95d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:29 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8 1073741824 Sep 07 02:22:29 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:29 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8a6831ba-8634-427e-a835-61e764667755 tempest-AttachVolumeTestJSON-1145787406 None] Created volume successfully. Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-df474336-7bc8-47b4-bfed-ccc503a5cdde req-3a0e5334-be89-46ee-adc6-16fb96e0295b tempest-TestInstancesWithCinderVolumes-674604342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-f03e2ef3-63b7-4596-bd88-d5d062138f87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4bf73851-9357-4ac5-b510-57e468e2d0a1', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:22:29 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-df474336-7bc8-47b4-bfed-ccc503a5cdde req-3a0e5334-be89-46ee-adc6-16fb96e0295b tempest-TestInstancesWithCinderVolumes-674604342 None] attachment_update completed successfully. Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (056f724f-5ed8-4702-a690-08b868db7ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68addc1-6f03-4ec0-80ba-a84eb8ad72c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68addc1-6f03-4ec0-80ba-a84eb8ad72c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-773059765',display_name='tempest-VolumesGetTest-Volume-1626056198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117b5327-f241-4dd9-8f95-174d1ed94830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:30Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ddc411-3f53-466d-bbdc-c418ce839df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ddc411-3f53-466d-bbdc-c418ce839df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b20182-990b-4d09-9889-760eccf753a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b20182-990b-4d09-9889-760eccf753a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117b5327-f241-4dd9-8f95-174d1ed94830', 'volume_name': 'volume-117b5327-f241-4dd9-8f95-174d1ed94830', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22dd5246-7ff3-4c86-98e7-9e4c3dea6b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22dd5246-7ff3-4c86-98e7-9e4c3dea6b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f200c399-e988-4f3c-ab4b-0c91541d2b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:29 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Volume 117b5327-f241-4dd9-8f95-174d1ed94830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117b5327-f241-4dd9-8f95-174d1ed94830', 'volume_size': 1} Sep 07 02:22:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:30 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8 1073741824" returned: 0 in 0.492s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:30 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8 Sep 07 02:22:30 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:30 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8" returned: 0 in 0.324s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-773059765',display_name='tempest-VolumesGetTest-Volume-1626056198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117b5327-f241-4dd9-8f95-174d1ed94830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:30Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Creating volume 117b5327-f241-4dd9-8f95-174d1ed94830 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:22:30 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dee12c0-ccfe-4bdd-81fb-a110619fc0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:30 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830 1073741824 Sep 07 02:22:30 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fefc64-3dd6-4c66-9b02-e766f2e232bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:30 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Volume volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8 (735a6414-e2b9-44f6-b39a-d0108bdc13d8): created successfully Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fefc64-3dd6-4c66-9b02-e766f2e232bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Flow 'volume_create_manager' (f2cf4754-555f-4e75-a4fe-fd4dc88433ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:30 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e065e4bc-e531-476f-9df8-301dbcac3336 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Created volume successfully. Sep 07 02:22:30 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830 1073741824" returned: 0 in 0.568s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:31 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830 Sep 07 02:22:31 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-a7758b6d-82e2-48dc-9191-f2f14f55f5d1 req-0c3b0a36-a20f-4845-8bdd-90c644340164 tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:31 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830" returned: 0 in 0.292s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-a7758b6d-82e2-48dc-9191-f2f14f55f5d1 req-0c3b0a36-a20f-4845-8bdd-90c644340164 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.251s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-a7758b6d-82e2-48dc-9191-f2f14f55f5d1 req-0c3b0a36-a20f-4845-8bdd-90c644340164 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f200c399-e988-4f3c-ab4b-0c91541d2b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117b5327-f241-4dd9-8f95-174d1ed94830', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5a0657-0aa7-476f-b9f1-c905a6e834ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:31 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Volume volume-117b5327-f241-4dd9-8f95-174d1ed94830 (117b5327-f241-4dd9-8f95-174d1ed94830): created successfully Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5a0657-0aa7-476f-b9f1-c905a6e834ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (056f724f-5ed8-4702-a690-08b868db7ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9661f653-18b4-4071-a31b-c6fb0386c524 tempest-VolumesGetTest-1558026568 None] Created volume successfully. Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-a7758b6d-82e2-48dc-9191-f2f14f55f5d1 req-0c3b0a36-a20f-4845-8bdd-90c644340164 tempest-AttachVolumeTestJSON-1145787406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f18d67e-680a-4d70-9371-667a962e48e5', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:22:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-a7758b6d-82e2-48dc-9191-f2f14f55f5d1 req-0c3b0a36-a20f-4845-8bdd-90c644340164 tempest-AttachVolumeTestJSON-1145787406 None] attachment_update completed successfully. Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-11a6d1e8-8b29-4532-b967-970073c27346 req-c76409ac-3515-4c79-9b30-3ea8fbd1dcbc tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-11a6d1e8-8b29-4532-b967-970073c27346 req-c76409ac-3515-4c79-9b30-3ea8fbd1dcbc tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-11a6d1e8-8b29-4532-b967-970073c27346 req-c76409ac-3515-4c79-9b30-3ea8fbd1dcbc tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-11a6d1e8-8b29-4532-b967-970073c27346 req-c76409ac-3515-4c79-9b30-3ea8fbd1dcbc tempest-TestInstancesWithCinderVolumes-674604342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0c47a49-9aae-49ae-904f-65241c9b6998', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:22:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-11a6d1e8-8b29-4532-b967-970073c27346 req-c76409ac-3515-4c79-9b30-3ea8fbd1dcbc tempest-TestInstancesWithCinderVolumes-674604342 None] attachment_update completed successfully. Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-117b5327-f241-4dd9-8f95-174d1ed94830-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Lock "cinder-117b5327-f241-4dd9-8f95-174d1ed94830-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-quobyte-117b5327-f241-4dd9-8f95-174d1ed94830" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-117b5327-f241-4dd9-8f95-174d1ed94830" acquired by "delete_volume" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b89efd-f43d-4175-8f05-d629f674be71]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:32 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830 Sep 07 02:22:32 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Acquiring lock "cinder-735a6414-e2b9-44f6-b39a-d0108bdc13d8-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Lock "cinder-735a6414-e2b9-44f6-b39a-d0108bdc13d8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Acquiring lock "cinder-quobyte-735a6414-e2b9-44f6-b39a-d0108bdc13d8" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Lock "cinder-quobyte-735a6414-e2b9-44f6-b39a-d0108bdc13d8" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59a1c8d-1a6f-4ab3-9b7c-eb6a0d062d54]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:32 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8 Sep 07 02:22:32 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:32 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830" returned: 0 in 0.415s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:32 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830 Sep 07 02:22:32 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:33 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8" returned: 0 in 0.384s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:33 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8 Sep 07 02:22:33 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:33 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-117b5327-f241-4dd9-8f95-174d1ed94830" returned: 0 in 0.281s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-117b5327-f241-4dd9-8f95-174d1ed94830" released by "delete_volume" :: held 0.752s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Created reservations ['96515510-cde0-43fb-ad41-cc74da63b6c2', 'aa5c6387-752d-42a8-bdfc-dd62b3a647c5', 'be66f61f-bd39-4bc4-9b6b-f539fe36311d', '6fad1063-617e-4ecf-b48b-2b79b41d2cb5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:33 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:33 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:33 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-735a6414-e2b9-44f6-b39a-d0108bdc13d8" returned: 0 in 0.285s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Lock "cinder-quobyte-735a6414-e2b9-44f6-b39a-d0108bdc13d8" released by "delete_volume" :: held 0.709s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Created reservations ['c1d308cc-2f02-4e23-b98a-3c7fedc72d2e', 'baa2f862-17cc-4685-9106-a0285f061253', 'd29823c4-66b9-4ce3-97e5-61d34f03301e', '9e5058bc-2e7d-4619-af09-b030c6b55361'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:33 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.285s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:33 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:33 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:33 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Deleted volume successfully. Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dac19ffe-3798-431d-b520-16c28e2e3e3b tempest-VolumesGetTest-1558026568 None] Lock "cinder-117b5327-f241-4dd9-8f95-174d1ed94830-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-75a625f9-16f4-47a1-aeb6-a293803577b1-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Lock "cinder-75a625f9-16f4-47a1-aeb6-a293803577b1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-quobyte-75a625f9-16f4-47a1-aeb6-a293803577b1" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-75a625f9-16f4-47a1-aeb6-a293803577b1" acquired by "delete_volume" :: waited 0.031s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c96268a-81ab-4b00-8e87-90de844123bf]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:33 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:22:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Flow 'volume_create_manager' (a5e76da7-8aff-4961-b504-cd07a78e73b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2687d69-94f2-41fc-bafc-203831d2acf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.438s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Deleted volume successfully. Sep 07 02:22:34 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1 Sep 07 02:22:34 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2687d69-94f2-41fc-bafc-203831d2acf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1109580748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de824e9-1edf-43a8-b0d3-4f4e2dd3663f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a523a306edb4c81889e2f6b861c3c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:34Z,use_quota=True,user_id='dae831d0ce3b4fc188d00ca8a192a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14af2de8-a06b-414d-a043-0e7e6c05839e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14af2de8-a06b-414d-a043-0e7e6c05839e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d9e7d8-3408-4fcd-9cc9-c38300822c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d9e7d8-3408-4fcd-9cc9-c38300822c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de824e9-1edf-43a8-b0d3-4f4e2dd3663f', 'volume_name': 'volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec664058-8ccf-4efb-8b77-3e76f9387995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec664058-8ccf-4efb-8b77-3e76f9387995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c876b777-391c-4206-997f-6bedf96ff5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:34 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Volume 1de824e9-1edf-43a8-b0d3-4f4e2dd3663f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f', 'volume_size': 1} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1109580748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de824e9-1edf-43a8-b0d3-4f4e2dd3663f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a523a306edb4c81889e2f6b861c3c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:34Z,use_quota=True,user_id='dae831d0ce3b4fc188d00ca8a192a4d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Creating volume 1de824e9-1edf-43a8-b0d3-4f4e2dd3663f {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:22:34 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:34 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f 1073741824 Sep 07 02:22:34 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa1e27c2-d44d-4bcd-bf5a-b4592bb73bf0 tempest-VolumeQuotasNegativeTestJSON-1519577587 None] Lock "cinder-735a6414-e2b9-44f6-b39a-d0108bdc13d8-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:34 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1" returned: 0 in 0.443s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:34 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1 Sep 07 02:22:34 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:34 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-75a625f9-16f4-47a1-aeb6-a293803577b1" returned: 0 in 0.306s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-75a625f9-16f4-47a1-aeb6-a293803577b1" released by "delete_volume" :: held 0.817s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:34 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f 1073741824" returned: 0 in 0.620s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Created reservations ['d42b877d-8530-4cf9-89e6-b491e3a222dd', '660850e9-a624-4544-ae35-5160333d5d72', 'b5ffd06a-99be-4bc5-a9ff-e91df16b501b', '5820e332-e073-4c5b-a769-ff26ec33ee13'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:34 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f Sep 07 02:22:34 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:34 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:34 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-4c1cf763-3087-4334-8089-22567bf1ff25-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Lock "cinder-4c1cf763-3087-4334-8089-22567bf1ff25-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-quobyte-4c1cf763-3087-4334-8089-22567bf1ff25" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-4c1cf763-3087-4334-8089-22567bf1ff25" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:35 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f" returned: 0 in 0.461s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:35 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a304d42-4a17-4f1b-9c23-c972925c5148]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.380s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:35 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Deleted volume successfully. Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c876b777-391c-4206-997f-6bedf96ff5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec21f54-c1c6-4522-b035-e1e7d9b373f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:35 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Volume volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f (1de824e9-1edf-43a8-b0d3-4f4e2dd3663f): created successfully Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec21f54-c1c6-4522-b035-e1e7d9b373f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Flow 'volume_create_manager' (a5e76da7-8aff-4961-b504-cd07a78e73b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c080c03-6ed5-44df-becc-a5464fb9bfcf tempest-VolumesGetTest-1558026568 None] Lock "cinder-75a625f9-16f4-47a1-aeb6-a293803577b1-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:35 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b4143a7f-ddf3-475c-ac4d-9c4dcf546e76 tempest-AttachVolumeTestJSON-1145787406 None] Created volume successfully. Sep 07 02:22:35 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 Sep 07 02:22:35 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:35 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25" returned: 0 in 0.411s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:35 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25 Sep 07 02:22:35 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:35 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4c1cf763-3087-4334-8089-22567bf1ff25" returned: 0 in 0.290s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-4c1cf763-3087-4334-8089-22567bf1ff25" released by "delete_volume" :: held 0.798s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:36 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Created reservations ['ecd929b1-32a6-40a9-b854-d1698c2d6510', 'fe2efbc2-c8c9-4298-97ad-48bb2a16bb15', '5439d390-6eb8-4a4c-9e24-5d3fa092b531', 'bc95b76b-ccbb-41e2-9924-d44379f1e37e'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:36 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:36 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:36 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.486s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:36 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Deleted volume successfully. Sep 07 02:22:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f66957d2-aae7-4baf-823f-4c755592054a tempest-VolumesGetTest-1558026568 None] Lock "cinder-4c1cf763-3087-4334-8089-22567bf1ff25-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-4acbd0f3-147e-4beb-a467-5ed1a9f15c77 req-9e1bc2d9-5c2c-4e23-8b23-b2cb52c84d6b tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-4acbd0f3-147e-4beb-a467-5ed1a9f15c77 req-9e1bc2d9-5c2c-4e23-8b23-b2cb52c84d6b tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-4acbd0f3-147e-4beb-a467-5ed1a9f15c77 req-9e1bc2d9-5c2c-4e23-8b23-b2cb52c84d6b tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-4acbd0f3-147e-4beb-a467-5ed1a9f15c77 req-9e1bc2d9-5c2c-4e23-8b23-b2cb52c84d6b tempest-AttachVolumeTestJSON-1145787406 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab3c8739-a209-4161-b0f8-350e36c19683', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:22:37 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-4acbd0f3-147e-4beb-a467-5ed1a9f15c77 req-9e1bc2d9-5c2c-4e23-8b23-b2cb52c84d6b tempest-AttachVolumeTestJSON-1145787406 None] attachment_update completed successfully. Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (0febeba1-d1de-424b-9590-8ffe6310706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019a016d-66b1-4fb3-b538-6521c2fd6299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019a016d-66b1-4fb3-b538-6521c2fd6299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-8065150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a781f1f1-ce89-4e2f-9a4f-944f1c675086,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:37Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abda2632-4dd8-4a5b-ad53-49a6f0f95d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abda2632-4dd8-4a5b-ad53-49a6f0f95d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d50ecc-2b90-4bf0-9af9-137927ee7e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG cinder.image.glance [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Creating Keystone auth plugin from conf {{(pid=87313) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 02:22:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d50ecc-2b90-4bf0-9af9-137927ee7e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a781f1f1-ce89-4e2f-9a4f-944f1c675086', 'volume_name': 'volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30de48fa-e950-4af3-bdef-c4fa875c1bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30de48fa-e950-4af3-bdef-c4fa875c1bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337cb429-7fcb-4775-8173-04b05c1237f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:38 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Volume a781f1f1-ce89-4e2f-9a4f-944f1c675086: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Trying to clone a781f1f1-ce89-4e2f-9a4f-944f1c675086 from image 923d33a7-8f5b-413a-bd44-620eb1f09c8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]). {{(pid=87313) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 02:22:38 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Image download 20.69 MB at 20.69 MB/s Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[879c1132-a022-4543-af85-fc6e94339c0d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-588b9f16-df28-42e9-8f7f-07e1137bf1a4 req-7a879abb-8133-483d-affd-c1feaa24e584 tempest-TestInstancesWithCinderVolumes-674604342 None] Terminate volume connection completed successfully. Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-588b9f16-df28-42e9-8f7f-07e1137bf1a4 req-7a879abb-8133-483d-affd-c1feaa24e584 tempest-TestInstancesWithCinderVolumes-674604342 None] Deleting attachment 4bf73851-9357-4ac5-b510-57e468e2d0a1. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:22:38 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD Sep 07 02:22:38 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:38 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Temporary image 923d33a7-8f5b-413a-bd44-620eb1f09c8b is fetched for user 3d6849d9cce14f4fa55b28c2773cf88a. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f0831c-6b0e-4d77-86ab-703c7bf29c2f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:39 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD Sep 07 02:22:39 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "cinder-f03e2ef3-63b7-4596-bd88-d5d062138f87-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-f03e2ef3-63b7-4596-bd88-d5d062138f87-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "cinder-quobyte-f03e2ef3-63b7-4596-bd88-d5d062138f87" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-quobyte-f03e2ef3-63b7-4596-bd88-d5d062138f87" acquired by "delete_volume" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4190ef3-6748-4407-b91d-c8e122f8087e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:39 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-8065150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a781f1f1-ce89-4e2f-9a4f-944f1c675086,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:37Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Creating volume a781f1f1-ce89-4e2f-9a4f-944f1c675086 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:22:39 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:39 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 1073741824 Sep 07 02:22:39 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:39 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87 Sep 07 02:22:39 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:39 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87" returned: 0 in 0.553s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:39 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87 Sep 07 02:22:39 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:40 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 1073741824" returned: 0 in 0.743s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:40 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 Sep 07 02:22:40 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:40 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f03e2ef3-63b7-4596-bd88-d5d062138f87" returned: 0 in 0.375s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-quobyte-f03e2ef3-63b7-4596-bd88-d5d062138f87" released by "delete_volume" :: held 1.006s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-9ac8162c-c3ce-48ff-8c35-96fd521c3b55 req-4161e0af-f4f1-41ca-938e-2e7dbd514bec tempest-AttachVolumeTestJSON-1145787406 None] Terminate volume connection completed successfully. Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-9ac8162c-c3ce-48ff-8c35-96fd521c3b55 req-4161e0af-f4f1-41ca-938e-2e7dbd514bec tempest-AttachVolumeTestJSON-1145787406 None] Deleting attachment 1f18d67e-680a-4d70-9371-667a962e48e5. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:22:40 devstack cinder-volume[87313]: WARNING cinder.quota [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748910283-1519463465 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748910283-1519463465, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:22:40 devstack cinder-volume[87313]: WARNING cinder.quota [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748910283-1519463465 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748910283-1519463465, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Created reservations ['897cc033-5f3f-498f-a6b3-270960bb5ba5', 'e4396f1a-081a-47c0-bac6-07cd6d5c0f12', 'd25fd1ef-d5e8-4e9c-ad96-e9f6ef211ded', '29e7288f-6d53-49fc-bcc9-128cd6220bb6'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:40 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086" returned: 0 in 0.344s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Attempting download of 923d33a7-8f5b-413a-bd44-620eb1f09c8b ((None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}])) to volume a781f1f1-ce89-4e2f-9a4f-944f1c675086. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 02:22:40 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:40 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c192722f-7962-411e-9b01-43f3a51d974c]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_3gmoyjum {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:40 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_3gmoyjum Sep 07 02:22:40 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:40 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.385s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:40 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Deleted volume successfully. Sep 07 02:22:41 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-066527ef-6578-408e-8547-399e5a6c2008 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-f03e2ef3-63b7-4596-bd88-d5d062138f87-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:41 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_3gmoyjum" returned: 0 in 0.399s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_3gmoyjum {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:41 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_3gmoyjum Sep 07 02:22:41 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:41 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_3gmoyjum" returned: 1 in 0.396s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_3gmoyjum' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:22:41 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f00bbe-b91f-4a87-983b-217b9b10b4a3]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:41 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD Sep 07 02:22:41 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:41 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-b91a1788-1b11-4949-82b3-44e76e7fa6ce req-4c4dcf10-9e03-4eda-b61b-d222f1b04ea8 tempest-AttachVolumeTestJSON-1145787406 None] Terminate volume connection completed successfully. Sep 07 02:22:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-b91a1788-1b11-4949-82b3-44e76e7fa6ce req-4c4dcf10-9e03-4eda-b61b-d222f1b04ea8 tempest-AttachVolumeTestJSON-1145787406 None] Deleting attachment ab3c8739-a209-4161-b0f8-350e36c19683. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:22:42 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD" returned: 0 in 0.566s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] 923d33a7-8f5b-413a-bd44-620eb1f09c8b was qcow2, converting to qcow2 {{(pid=87313) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:42 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 Sep 07 02:22:42 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Flow 'volume_create_manager' (18a5ebbb-fc89-4f99-8c9d-1bf381e09323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a46b83-1143-4511-a0a4-540a11ebfd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a46b83-1143-4511-a0a4-540a11ebfd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-272535428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3876e9f4-45e9-4b28-ac20-0d6c0f2b969e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18529f61d9974d3fa50bb4e4abd246a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:43Z,use_quota=True,user_id='08019823caf64c41abb1515420c15b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc00b69-b81a-4e48-a1a5-2c8341e89a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc00b69-b81a-4e48-a1a5-2c8341e89a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720c73cc-d016-4449-a985-f2366131dedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720c73cc-d016-4449-a985-f2366131dedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3876e9f4-45e9-4b28-ac20-0d6c0f2b969e', 'volume_name': 'volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6863bf-b269-48bf-bae0-6e6d3e1cefe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6863bf-b269-48bf-bae0-6e6d3e1cefe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef2278e-27cf-4a24-9faf-e53d0de51f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:42 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Volume 3876e9f4-45e9-4b28-ac20-0d6c0f2b969e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e', 'volume_size': 1} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-272535428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3876e9f4-45e9-4b28-ac20-0d6c0f2b969e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18529f61d9974d3fa50bb4e4abd246a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:43Z,use_quota=True,user_id='08019823caf64c41abb1515420c15b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Creating volume 3876e9f4-45e9-4b28-ac20-0d6c0f2b969e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:22:42 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:22:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:42 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e 1073741824 Sep 07 02:22:42 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:43 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e 1073741824" returned: 0 in 0.706s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:43 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e Sep 07 02:22:43 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:43 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-8eae795c-f833-4e67-8254-cff8f800a065 req-a70ee687-9e5d-40f2-b485-958f45789b3b tempest-TestInstancesWithCinderVolumes-674604342 None] Terminate volume connection completed successfully. Sep 07 02:22:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-8eae795c-f833-4e67-8254-cff8f800a065 req-a70ee687-9e5d-40f2-b485-958f45789b3b tempest-TestInstancesWithCinderVolumes-674604342 None] Deleting attachment d0c47a49-9aae-49ae-904f-65241c9b6998. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:22:44 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e" returned: 0 in 0.524s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef2278e-27cf-4a24-9faf-e53d0de51f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbcccbe-49a2-401a-a294-2a2deb6b998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:44 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Volume volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e (3876e9f4-45e9-4b28-ac20-0d6c0f2b969e): created successfully Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbcccbe-49a2-401a-a294-2a2deb6b998c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Flow 'volume_create_manager' (18a5ebbb-fc89-4f99-8c9d-1bf381e09323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:44 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f2905564-d332-4577-8ffb-867de5fd8966 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Created volume successfully. Sep 07 02:22:44 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086" returned: 0 in 2.446s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_379wc7vxdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:22:44 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Converted 112.00 MB image at 45.77 MB/s Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:44 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 1G Sep 07 02:22:44 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "cinder-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "cinder-quobyte-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-quobyte-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23" acquired by "delete_volume" :: waited 0.037s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[934ffe88-374f-420a-a3b5-708bb86da23f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:45 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23 Sep 07 02:22:45 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:45 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 1G" returned: 0 in 0.613s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Downloaded image 923d33a7-8f5b-413a-bd44-620eb1f09c8b ((None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}])) to volume a781f1f1-ce89-4e2f-9a4f-944f1c675086 successfully. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Temporary image 923d33a7-8f5b-413a-bd44-620eb1f09c8b for user 3d6849d9cce14f4fa55b28c2773cf88a is deleted. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Marking volume a781f1f1-ce89-4e2f-9a4f-944f1c675086 as bootable. {{(pid=87313) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Copying metadata from image 923d33a7-8f5b-413a-bd44-620eb1f09c8b to a781f1f1-ce89-4e2f-9a4f-944f1c675086. {{(pid=87313) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Creating volume glance metadata for volume a781f1f1-ce89-4e2f-9a4f-944f1c675086 backed by image 923d33a7-8f5b-413a-bd44-620eb1f09c8b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87313) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Creating offline snapshot d614387c-ac63-470c-9f9d-fba2816b854e of volume 3876e9f4-45e9-4b28-ac20-0d6c0f2b969e {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:22:45 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337cb429-7fcb-4775-8173-04b05c1237f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b65db12-820e-409e-8bd5-e46e8ce883a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a02241-aaac-4c18-a6fa-c06e87ba6aad]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23" returned: 0 in 0.642s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:45 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Volume volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 (a781f1f1-ce89-4e2f-9a4f-944f1c675086): created successfully Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b65db12-820e-409e-8bd5-e46e8ce883a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (0febeba1-d1de-424b-9590-8ffe6310706c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:45 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23 Sep 07 02:22:45 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:45 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ce5ef07b-38cc-4df4-83d9-f42eae2ec36c tempest-VolumesGetTest-1558026568 None] Created volume successfully. Sep 07 02:22:45 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e Sep 07 02:22:45 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:45 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23" returned: 0 in 0.354s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-quobyte-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23" released by "delete_volume" :: held 1.065s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:45 devstack cinder-volume[87313]: WARNING cinder.quota [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-426045003-1908673751 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-426045003-1908673751, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:22:45 devstack cinder-volume[87313]: WARNING cinder.quota [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-426045003-1908673751 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-426045003-1908673751, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Created reservations ['734e779b-dfad-4f79-a13b-988575abc47f', '8e55ba18-c391-41fc-9942-0c4dd6a3930f', '479eb6f3-4402-49e3-95ea-fd236b610054', 'df2c1e0a-abf7-41a5-901f-5492f6ae21ab'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:45 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e" returned: 0 in 0.501s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:45 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e 1G Sep 07 02:22:45 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:46 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:46 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:46 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.342s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:46 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:46 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Deleted volume successfully. Sep 07 02:22:46 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de21d8dc-81d7-4cc6-9fd2-42862789a351 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-b4d2d514-adb2-4f2f-8e1b-11bc12f80c23-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:46 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e 1G" returned: 0 in 0.622s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:46 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e Sep 07 02:22:46 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:46 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e" returned: 0 in 0.387s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:46 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e is being set with open permissions: ugo+rw Sep 07 02:22:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:46 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e Sep 07 02:22:46 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:47 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e" returned: 0 in 0.343s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:47 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.info Sep 07 02:22:47 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (cf60cffb-baa3-4206-841f-f32c7538be98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2f33cc-32a2-458c-b13a-d4a8193468be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2f33cc-32a2-458c-b13a-d4a8193468be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-50509404',display_name='tempest-VolumesGetTest-Volume-1848408823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5926ad0b-8e00-4c24-9c7a-cce09607af43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:47Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32acd26f-299c-4a96-8b82-b4d379aa4c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32acd26f-299c-4a96-8b82-b4d379aa4c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789e9a06-9363-4ed3-8439-ff279fac0c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789e9a06-9363-4ed3-8439-ff279fac0c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5926ad0b-8e00-4c24-9c7a-cce09607af43', 'volume_name': 'volume-5926ad0b-8e00-4c24-9c7a-cce09607af43', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f04544a-c209-4710-b889-d27f148270d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f04544a-c209-4710-b889-d27f148270d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9916637a-690d-47c0-ae4e-d31991b1fe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:47 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Volume 5926ad0b-8e00-4c24-9c7a-cce09607af43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5926ad0b-8e00-4c24-9c7a-cce09607af43', 'volume_size': 1} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:47 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.info" returned: 0 in 0.362s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:47 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.info is being set with open permissions: ugo+rw Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:47 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.info Sep 07 02:22:47 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "cinder-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "cinder-quobyte-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-quobyte-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a1b790-7c1c-461a-89a9-aabf2eb0f9d6]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:48 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f Sep 07 02:22:48 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:48 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.info" returned: 0 in 0.392s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.759s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.603s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:22:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-50509404',display_name='tempest-VolumesGetTest-Volume-1848408823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5926ad0b-8e00-4c24-9c7a-cce09607af43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13099940a0624ac0a492d888ec261881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:22:47Z,use_quota=True,user_id='3d6849d9cce14f4fa55b28c2773cf88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Creating volume 5926ad0b-8e00-4c24-9c7a-cce09607af43 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:22:48 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:48 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43 1073741824 Sep 07 02:22:48 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:48 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e01408a4-a5f4-492a-b6f0-55cec6f057a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Create snapshot completed successfully Sep 07 02:22:48 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f" returned: 0 in 0.518s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:48 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f Sep 07 02:22:48 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:48 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:48 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43 1073741824" returned: 0 in 0.807s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f" returned: 0 in 0.538s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-quobyte-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f" released by "delete_volume" :: held 1.130s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:49 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43 Sep 07 02:22:49 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Created reservations ['d3bf7059-a907-4f23-865e-841d84fe7e19', '84ba0ee9-070d-4691-b0b8-b38ed2961f16', '77557a6b-f0bb-4e86-b64a-6874ee3566f3', '6bb0fa86-f9f2-424f-a135-6ec8a821e022'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:49 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:49 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Acquiring lock "cinder-d614387c-ac63-470c-9f9d-fba2816b854e-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:49 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43" returned: 0 in 0.410s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "cinder-d614387c-ac63-470c-9f9d-fba2816b854e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Acquiring lock "cinder-quobyte-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9916637a-690d-47c0-ae4e-d31991b1fe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5926ad0b-8e00-4c24-9c7a-cce09607af43', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6afeba-eca8-4f92-91d2-fa90513f7213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "cinder-quobyte-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Acquiring lock "cinder-quobyte-d614387c-ac63-470c-9f9d-fba2816b854e" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:49 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Volume volume-5926ad0b-8e00-4c24-9c7a-cce09607af43 (5926ad0b-8e00-4c24-9c7a-cce09607af43): created successfully Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6afeba-eca8-4f92-91d2-fa90513f7213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Flow 'volume_create_manager' (cf60cffb-baa3-4206-841f-f32c7538be98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "cinder-quobyte-d614387c-ac63-470c-9f9d-fba2816b854e" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:49 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Deleting offline snapshot d614387c-ac63-470c-9f9d-fba2816b854e of volume 3876e9f4-45e9-4b28-ac20-0d6c0f2b969e {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] snapshot_file for this snap is: volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.441s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:49 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-fce1d63d-87a8-4ae1-a176-79534d3f8646 tempest-VolumesGetTest-1558026568 None] Created volume successfully. Sep 07 02:22:49 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Deleted volume successfully. Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[baacaee9-7141-43c1-9c8c-98e8e7b531e9]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-451e96f8-b4d8-4bf7-9e70-ebefc5b75c97 tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-1de824e9-1edf-43a8-b0d3-4f4e2dd3663f-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:49 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e Sep 07 02:22:49 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-2baad53f-be5c-4e37-80f2-6994b2fb0cf8 req-8ad58433-b251-4516-89cb-54a9d8e39188 tempest-TestInstancesWithCinderVolumes-674604342 None] Terminate volume connection completed successfully. Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-2baad53f-be5c-4e37-80f2-6994b2fb0cf8 req-8ad58433-b251-4516-89cb-54a9d8e39188 tempest-TestInstancesWithCinderVolumes-674604342 None] Deleting attachment ed761fdd-8129-4061-a06c-176b2c1d3c07. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:22:50 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e" returned: 0 in 0.466s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "cinder-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f196a092-b0d3-4c19-bdbd-5289577bed47]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "cinder-quobyte-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-quobyte-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06f8b8a-9153-41e3-b68e-9d7c7c814713]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:50 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e Sep 07 02:22:50 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:50 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc Sep 07 02:22:50 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:50 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e" returned: 0 in 0.462s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:50 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e Sep 07 02:22:50 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:50 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc" returned: 0 in 0.534s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:50 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc Sep 07 02:22:50 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-5926ad0b-8e00-4c24-9c7a-cce09607af43-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Lock "cinder-5926ad0b-8e00-4c24-9c7a-cce09607af43-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-quobyte-5926ad0b-8e00-4c24-9c7a-cce09607af43" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-5926ad0b-8e00-4c24-9c7a-cce09607af43" acquired by "delete_volume" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[413c5b65-39a0-4989-803a-a161349dadcc]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:51 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e" returned: 0 in 0.428s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:51 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:51 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc" returned: 0 in 0.284s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:51 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:51 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43 Sep 07 02:22:51 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "cinder-afc4d19c-b104-4d18-966f-2fc9eacf0609-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-quobyte-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc" released by "delete_volume" :: held 0.876s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-afc4d19c-b104-4d18-966f-2fc9eacf0609-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Created reservations ['fc5bd32c-5df2-42ae-b61a-29a60f42ff88', '59b87a1e-9be5-4011-b791-4c19e5aa2af3', '1c22ae52-680b-4490-ab55-c3ea042f809d', '4d427596-e539-4c7d-a103-4a6942278b01'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "cinder-quobyte-afc4d19c-b104-4d18-966f-2fc9eacf0609" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-quobyte-afc4d19c-b104-4d18-966f-2fc9eacf0609" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c776cbe-7bcc-48e5-be81-0e868e4ff7b3]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:51 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:51 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:51 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e.d614387c-ac63-470c-9f9d-fba2816b854e" returned: 0 in 0.339s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:51 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:51 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 Sep 07 02:22:51 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43" returned: 0 in 0.492s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "cinder-quobyte-d614387c-ac63-470c-9f9d-fba2816b854e" released by "_delete_snapshot" :: held 1.870s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "cinder-quobyte-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e" released by "delete_snapshot" :: held 1.934s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:51 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43 Sep 07 02:22:51 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "cinder-c7afe189-e828-4c6e-9652-cd234888dd29-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-c7afe189-e828-4c6e-9652-cd234888dd29-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "cinder-quobyte-c7afe189-e828-4c6e-9652-cd234888dd29" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Created reservations ['68ee5cde-4155-49cd-b7f0-c03fe32a8f83', '0e4894f6-dce2-4733-8123-a65e168aa521', '27252bbe-b5f0-44b3-bb2a-37120641e481', '278673df-7275-41e7-a902-87189c677f9a'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-quobyte-c7afe189-e828-4c6e-9652-cd234888dd29" acquired by "delete_volume" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:51 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[1204575f-73f2-46a3-b34f-c4e2a0231d46]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.414s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:51 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Deleted volume successfully. Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7e3f73da-86c0-4842-a9b1-51adf1f61ced tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-871ad0ae-740d-45d9-bd9e-ed4ec2ddb1bc-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:51 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Delete snapshot completed successfully. Sep 07 02:22:51 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609" returned: 0 in 0.551s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de572047-ad1a-4884-a45a-580566ad1375 tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "cinder-d614387c-ac63-470c-9f9d-fba2816b854e-delete_snapshot" released by "delete_snapshot" :: held 2.328s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:51 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609 Sep 07 02:22:51 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:51 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5926ad0b-8e00-4c24-9c7a-cce09607af43" returned: 0 in 0.385s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-5926ad0b-8e00-4c24-9c7a-cce09607af43" released by "delete_volume" :: held 0.919s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:51 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29 Sep 07 02:22:51 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Created reservations ['0fbd02f3-58dc-475d-aa1c-4df52154a239', '296b21cd-8f30-4049-b265-fe60a8cc98c0', '02bd177f-111d-4c4a-be48-92740477fec1', 'e39bee44-d5c0-47ea-b074-2abab07133d0'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:51 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:51 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:52 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-afc4d19c-b104-4d18-966f-2fc9eacf0609" returned: 0 in 0.305s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-quobyte-afc4d19c-b104-4d18-966f-2fc9eacf0609" released by "delete_volume" :: held 0.907s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-a781f1f1-ce89-4e2f-9a4f-944f1c675086-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Lock "cinder-a781f1f1-ce89-4e2f-9a4f-944f1c675086-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:52 devstack cinder-volume[87313]: WARNING cinder.quota [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96184431-1454952958 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96184431-1454952958, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:22:52 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:52 devstack cinder-volume[87313]: WARNING cinder.quota [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96184431-1454952958 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-96184431-1454952958, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29" returned: 0 in 0.521s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Acquiring lock "cinder-quobyte-a781f1f1-ce89-4e2f-9a4f-944f1c675086" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:52 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29 Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-a781f1f1-ce89-4e2f-9a4f-944f1c675086" acquired by "delete_volume" :: waited 0.043s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:52 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:52 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Created reservations ['6a86e51f-7080-475d-adcf-e9c65834f794', 'a8983853-e75d-41fe-85f2-f7aa2001bad3', 'ab855f06-bdd0-4a57-8a26-6c37a70388ff', 'dbd906ba-cbcc-49c5-af52-9219a615d642'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.308s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85b24d1-7f58-4ff5-9bb8-a4fa1f8d028e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Deleted volume successfully. Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2509d2e5-17dc-4fc8-9c4e-50c33dbde8d2 tempest-VolumesGetTest-1558026568 None] Lock "cinder-5926ad0b-8e00-4c24-9c7a-cce09607af43-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:52 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 Sep 07 02:22:52 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:52 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:52 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:52 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7afe189-e828-4c6e-9652-cd234888dd29" returned: 0 in 0.273s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-quobyte-c7afe189-e828-4c6e-9652-cd234888dd29" released by "delete_volume" :: held 0.847s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Created reservations ['4056d3be-fea3-4e13-9fd5-8c498d180b45', '4af9fd82-33d7-44d5-ad76-04ba05b85910', '6ac48499-4cd5-4a30-bdeb-c30fd1bb779a', 'c28de670-ecce-457a-a595-5c368cc79172'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:52 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:52 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:52 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.314s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Deleted volume successfully. Sep 07 02:22:52 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c9dfe80-9333-494c-83a4-e201c088aaa9 tempest-TestInstancesWithCinderVolumes-674604342 None] Lock "cinder-afc4d19c-b104-4d18-966f-2fc9eacf0609-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086" returned: 0 in 0.476s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:52 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086 Sep 07 02:22:52 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Acquiring lock "cinder-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "cinder-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Acquiring lock "cinder-quobyte-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "cinder-quobyte-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e" acquired by "delete_volume" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b65536-5ea1-435d-8b63-cf34e29857a6]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:22:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:53 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.364s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:53 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Deleted volume successfully. Sep 07 02:22:53 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1117b3d1-3cdd-4cd6-bb42-41de2793c15b tempest-AttachVolumeTestJSON-1145787406 None] Lock "cinder-c7afe189-e828-4c6e-9652-cd234888dd29-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a781f1f1-ce89-4e2f-9a4f-944f1c675086" returned: 0 in 0.301s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Lock "cinder-quobyte-a781f1f1-ce89-4e2f-9a4f-944f1c675086" released by "delete_volume" :: held 0.821s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:53 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e Sep 07 02:22:53 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Created reservations ['e438f110-bf65-41de-a6ef-35e29ec49017', '6398c7a9-65ba-41bd-8aa3-05bc7f6a3aed', '23df9cad-a6a0-474d-9193-dff12ff9221c', 'e6ec937d-f773-4aed-a202-20f8b21abbe5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:53 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:53 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:53 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e" returned: 0 in 0.463s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:53 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e Sep 07 02:22:53 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:53 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.342s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:53 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Deleted volume successfully. Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3663775f-e8f0-4402-b1e3-7093a953883b tempest-VolumesGetTest-1558026568 None] Lock "cinder-a781f1f1-ce89-4e2f-9a4f-944f1c675086-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:53 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e" returned: 0 in 0.371s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "cinder-quobyte-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e" released by "delete_volume" :: held 0.914s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:22:53 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Created reservations ['11821592-d2ff-4080-a257-9077b2d09162', '4d58ee7e-0b69-457f-b358-869a6413004b', 'da943c39-d01d-4510-afff-f78552cbb23e', '9eabd902-ad20-4859-b379-005b7258c692'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:22:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:22:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:22:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:22:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:22:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:22:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:22:54 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:22:54 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:22:54 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 07 02:22:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.372s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:22:54 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:22:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Deleted volume successfully. Sep 07 02:22:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eaf64534-9590-4cf3-a1b7-a26c1398b18d tempest-VolumeSnapshotQuotasNegativeTestJSON-849297227 None] Lock "cinder-3876e9f4-45e9-4b28-ac20-0d6c0f2b969e-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:23:03 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=121,cinder:UPDATE=141,cinder:INSERT=40,cinder:DELETE=9 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=149,cinder:INSERT=44,cinder:UPDATE=173,cinder:DELETE=15 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Flow 'volume_create_manager' (39caad53-913f-4267-b7e0-91f8e2d62b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0e120f-444a-4fd4-bc2b-d4e503012da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0e120f-444a-4fd4-bc2b-d4e503012da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2025847387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e9b77e-06a4-489e-a271-b9a32f156461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af54f0f8a143138a2ff8e99e12021d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:04Z,use_quota=True,user_id='2952260267584aceb9890d1ab055cda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d747a72e-f1fa-45d0-baef-bfbfeeaf339d),volume_type_id=d747a72e-f1fa-45d0-baef-bfbfeeaf339d)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319728d4-e8ef-4283-b076-91a0ba9aee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319728d4-e8ef-4283-b076-91a0ba9aee85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e748b0a-9cb3-47da-b335-1391329dafba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e748b0a-9cb3-47da-b335-1391329dafba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e9b77e-06a4-489e-a271-b9a32f156461', 'volume_name': 'volume-22e9b77e-06a4-489e-a271-b9a32f156461', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd83017f-9f43-4cd9-a78b-206f2ce5b2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd83017f-9f43-4cd9-a78b-206f2ce5b2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ee5273-a9de-4288-80b0-202aef1407a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:04 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Volume 22e9b77e-06a4-489e-a271-b9a32f156461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e9b77e-06a4-489e-a271-b9a32f156461', 'volume_size': 1} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2025847387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e9b77e-06a4-489e-a271-b9a32f156461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af54f0f8a143138a2ff8e99e12021d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:04Z,use_quota=True,user_id='2952260267584aceb9890d1ab055cda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d747a72e-f1fa-45d0-baef-bfbfeeaf339d),volume_type_id=d747a72e-f1fa-45d0-baef-bfbfeeaf339d)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Creating volume 22e9b77e-06a4-489e-a271-b9a32f156461 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:23:04 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:23:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:04 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461 1073741824 Sep 07 02:23:04 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:05 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461 1073741824" returned: 0 in 0.633s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:05 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461 Sep 07 02:23:05 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:05 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461" returned: 0 in 0.286s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:23:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ee5273-a9de-4288-80b0-202aef1407a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e9b77e-06a4-489e-a271-b9a32f156461', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ba9fd9-676a-4120-8a07-71a3307f1505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:05 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Volume volume-22e9b77e-06a4-489e-a271-b9a32f156461 (22e9b77e-06a4-489e-a271-b9a32f156461): created successfully Sep 07 02:23:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ba9fd9-676a-4120-8a07-71a3307f1505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Flow 'volume_create_manager' (39caad53-913f-4267-b7e0-91f8e2d62b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f79e23ef-1358-401e-a6a8-2509173ef533 tempest-VolumeTypesAccessTest-1696699748 None] Created volume successfully. Sep 07 02:23:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Acquiring lock "cinder-22e9b77e-06a4-489e-a271-b9a32f156461-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:23:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Lock "cinder-22e9b77e-06a4-489e-a271-b9a32f156461-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:23:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Acquiring lock "cinder-quobyte-22e9b77e-06a4-489e-a271-b9a32f156461" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:23:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Lock "cinder-quobyte-22e9b77e-06a4-489e-a271-b9a32f156461" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:23:06 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfe523c-139a-478c-b8bb-69d8b1cca15e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:23:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:06 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461 Sep 07 02:23:06 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:07 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461" returned: 0 in 0.419s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:07 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461 Sep 07 02:23:07 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:07 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22e9b77e-06a4-489e-a271-b9a32f156461" returned: 0 in 0.300s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Lock "cinder-quobyte-22e9b77e-06a4-489e-a271-b9a32f156461" released by "delete_volume" :: held 0.779s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:23:07 devstack cinder-volume[87313]: WARNING cinder.quota [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-804885154 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-804885154, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:23:07 devstack cinder-volume[87313]: WARNING cinder.quota [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-804885154 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-804885154, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:23:07 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Created reservations ['2e6abcec-8999-4883-8915-3f6cf3075a84', '39d71a66-dd34-4a59-b2ae-c4748979e339', '9c93f112-2187-4e4e-a1f6-7abdd7031f6f', '131fd69c-4e6f-4f6b-8f25-951b4e2af826'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:23:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:07 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:23:07 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:08 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.303s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:08 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:23:08 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Deleted volume successfully. Sep 07 02:23:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b673794-a8e5-42af-99b2-024a7fb2936f tempest-VolumeTypesAccessTest-1696699748 None] Lock "cinder-22e9b77e-06a4-489e-a271-b9a32f156461-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:23:17 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:23:18 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Flow 'volume_create_manager' (32733887-1922-4c66-b6a1-5a1a65f40450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2fbe4c-ed20-4b57-bbdb-b3fbd18fa4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2fbe4c-ed20-4b57-bbdb-b3fbd18fa4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-476316809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3eeb99-786f-4268-888d-fe2084a9ffb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fe55361fa941af8ded04bf62ece87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:21Z,use_quota=True,user_id='1e915e48e65d4d60a4190efb61822522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54549e2-52d4-4522-adce-da2a4b4b36e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54549e2-52d4-4522-adce-da2a4b4b36e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e64aa68-f9d4-4af2-b4cb-9b91192f7816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e64aa68-f9d4-4af2-b4cb-9b91192f7816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3eeb99-786f-4268-888d-fe2084a9ffb4', 'volume_name': 'volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefba1cf-fdaf-4fed-986f-a4493632fd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefba1cf-fdaf-4fed-986f-a4493632fd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad02547-5666-4e3d-af1b-f1ef90cd6e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:20 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Volume 0a3eeb99-786f-4268-888d-fe2084a9ffb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4', 'volume_size': 1} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-476316809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3eeb99-786f-4268-888d-fe2084a9ffb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fe55361fa941af8ded04bf62ece87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:21Z,use_quota=True,user_id='1e915e48e65d4d60a4190efb61822522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Creating volume 0a3eeb99-786f-4268-888d-fe2084a9ffb4 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:23:20 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:23:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:20 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4 1073741824 Sep 07 02:23:20 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Flow 'volume_create_manager' (4f641a2a-c158-4fca-91ce-6b4b58c305e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2189bf80-27e4-46c3-8678-9a54daa73408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2189bf80-27e4-46c3-8678-9a54daa73408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1759034342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a52fb2b-6fb5-4288-b5f8-144a51a19a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fe55361fa941af8ded04bf62ece87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:21Z,use_quota=True,user_id='1e915e48e65d4d60a4190efb61822522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeabeed5-0bf9-4aad-abea-eff778adf631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeabeed5-0bf9-4aad-abea-eff778adf631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:21 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221eae96-258e-4813-aeb7-d8632eb9cdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221eae96-258e-4813-aeb7-d8632eb9cdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a52fb2b-6fb5-4288-b5f8-144a51a19a05', 'volume_name': 'volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dda3bbe-4efc-4fee-b291-494dd054dfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dda3bbe-4efc-4fee-b291-494dd054dfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fff4943-bf42-488a-b537-fe83b694b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:21 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Volume 9a52fb2b-6fb5-4288-b5f8-144a51a19a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05', 'volume_size': 1} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4 1073741824" returned: 0 in 0.698s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:21 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4 Sep 07 02:23:21 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:21 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4" returned: 0 in 0.299s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.372s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1759034342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a52fb2b-6fb5-4288-b5f8-144a51a19a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fe55361fa941af8ded04bf62ece87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:21Z,use_quota=True,user_id='1e915e48e65d4d60a4190efb61822522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Creating volume 9a52fb2b-6fb5-4288-b5f8-144a51a19a05 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:23:22 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad02547-5666-4e3d-af1b-f1ef90cd6e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a09572e-1a33-4011-b3e6-56f62aec5377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:22 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05 1073741824 Sep 07 02:23:22 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:22 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Volume volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4 (0a3eeb99-786f-4268-888d-fe2084a9ffb4): created successfully Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a09572e-1a33-4011-b3e6-56f62aec5377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Flow 'volume_create_manager' (32733887-1922-4c66-b6a1-5a1a65f40450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:22 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-52950a0a-f927-4b29-9f8b-6a027f2687b9 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Created volume successfully. Sep 07 02:23:22 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05 1073741824" returned: 0 in 0.596s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:22 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05 Sep 07 02:23:22 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:22 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05" returned: 0 in 0.280s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fff4943-bf42-488a-b537-fe83b694b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39479e9e-8126-4f1c-8cfe-313c104a3478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:22 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Volume volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05 (9a52fb2b-6fb5-4288-b5f8-144a51a19a05): created successfully Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39479e9e-8126-4f1c-8cfe-313c104a3478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Flow 'volume_create_manager' (4f641a2a-c158-4fca-91ce-6b4b58c305e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:22 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-aa44f471-694c-459a-82ac-fa0c0512b01c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Created volume successfully. Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:26 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:23:26 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:26 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.328s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:23:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:23:32 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:23:32 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:23:38 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:23:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Flow 'volume_create_manager' (56fd90fb-b696-4efc-b9e6-25149d8b6b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0ccf38-7794-45d7-80fb-4fb608709ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0ccf38-7794-45d7-80fb-4fb608709ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-941195060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf78f9c-17c0-4a97-80e9-a99b20e24238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692c8e48a7c143b5b1e02a8d092b449e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:39Z,use_quota=True,user_id='3975c74e8a4e4c33965d958a841f6601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3dba4c-042d-46e6-b681-205fbb04a568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3dba4c-042d-46e6-b681-205fbb04a568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8cbb80-693c-4f70-ac84-c2144bc53fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8cbb80-693c-4f70-ac84-c2144bc53fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf78f9c-17c0-4a97-80e9-a99b20e24238', 'volume_name': 'volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e098e160-f7f6-49bf-95b2-a4b5ad54586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e098e160-f7f6-49bf-95b2-a4b5ad54586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe09220e-47e6-4687-81ec-e14734277448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:39 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Volume 3bf78f9c-17c0-4a97-80e9-a99b20e24238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238', 'volume_size': 1} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-941195060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf78f9c-17c0-4a97-80e9-a99b20e24238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692c8e48a7c143b5b1e02a8d092b449e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:39Z,use_quota=True,user_id='3975c74e8a4e4c33965d958a841f6601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Creating volume 3bf78f9c-17c0-4a97-80e9-a99b20e24238 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:23:39 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:39 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238 1073741824 Sep 07 02:23:39 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:39 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238 1073741824" returned: 0 in 0.624s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:39 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238 Sep 07 02:23:39 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:40 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238" returned: 0 in 0.332s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:23:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe09220e-47e6-4687-81ec-e14734277448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbb8f75-6651-4bb6-8c07-65a0681650f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:40 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Volume volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238 (3bf78f9c-17c0-4a97-80e9-a99b20e24238): created successfully Sep 07 02:23:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbb8f75-6651-4bb6-8c07-65a0681650f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Flow 'volume_create_manager' (56fd90fb-b696-4efc-b9e6-25149d8b6b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-bbf76a24-2082-4cd1-84f0-bc8ea83a5c30 tempest-VolumesListAdminTestJSON-1107938188 None] Created volume successfully. Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Flow 'volume_create_manager' (1213e972-798b-44fa-a4bd-a956f05211e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4daf969-3832-491b-be9b-176f2ee5c579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4daf969-3832-491b-be9b-176f2ee5c579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-581416422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692c8e48a7c143b5b1e02a8d092b449e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:42Z,use_quota=True,user_id='3975c74e8a4e4c33965d958a841f6601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b40f88-607a-428b-a5e6-b06af2d09856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b40f88-607a-428b-a5e6-b06af2d09856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28799b2a-7132-4c72-be74-ace944dcd616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28799b2a-7132-4c72-be74-ace944dcd616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3', 'volume_name': 'volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cceeb2-d760-45e3-83da-f00648f231ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cceeb2-d760-45e3-83da-f00648f231ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97d6b04-9961-414f-874f-28f86d118d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:41 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Volume 940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3', 'volume_size': 1} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-581416422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692c8e48a7c143b5b1e02a8d092b449e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:42Z,use_quota=True,user_id='3975c74e8a4e4c33965d958a841f6601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Creating volume 940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:23:41 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:23:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:41 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3 1073741824 Sep 07 02:23:41 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:42 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3 1073741824" returned: 0 in 0.548s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:42 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3 Sep 07 02:23:42 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:42 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3" returned: 0 in 0.340s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:23:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97d6b04-9961-414f-874f-28f86d118d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c951438-5051-4d59-89a4-fe2ea6b4923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:42 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Volume volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3 (940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3): created successfully Sep 07 02:23:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c951438-5051-4d59-89a4-fe2ea6b4923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Flow 'volume_create_manager' (1213e972-798b-44fa-a4bd-a956f05211e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:42 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-cef0a065-fd49-44f0-bb41-91f6d7344d46 tempest-VolumesListAdminTestJSON-1107938188 None] Created volume successfully. Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Flow 'volume_create_manager' (54971e08-a48e-45be-819c-d00f6a80f940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cc07be-e0d6-4bb6-b349-8bbb8f706cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cc07be-e0d6-4bb6-b349-8bbb8f706cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1135112045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3384c807-5ac5-460d-b5c4-a24e2fe9da99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692c8e48a7c143b5b1e02a8d092b449e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:45Z,use_quota=True,user_id='3975c74e8a4e4c33965d958a841f6601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a570cadc-09e3-43d9-a13e-22077df729df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a570cadc-09e3-43d9-a13e-22077df729df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae5fd00-044b-4131-8830-ec8e6f5fda75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae5fd00-044b-4131-8830-ec8e6f5fda75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3384c807-5ac5-460d-b5c4-a24e2fe9da99', 'volume_name': 'volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1854528f-c349-43e1-8362-2342afec3c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1854528f-c349-43e1-8362-2342afec3c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80aff129-cda8-4a74-ad1c-8672e718f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:44 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Volume 3384c807-5ac5-460d-b5c4-a24e2fe9da99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99', 'volume_size': 1} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1135112045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3384c807-5ac5-460d-b5c4-a24e2fe9da99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692c8e48a7c143b5b1e02a8d092b449e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:45Z,use_quota=True,user_id='3975c74e8a4e4c33965d958a841f6601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Creating volume 3384c807-5ac5-460d-b5c4-a24e2fe9da99 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:23:44 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:23:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:44 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99 1073741824 Sep 07 02:23:44 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:45 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99 1073741824" returned: 0 in 0.629s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:45 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99 Sep 07 02:23:45 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:46 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99" returned: 0 in 0.616s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:23:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80aff129-cda8-4a74-ad1c-8672e718f114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93959eab-ea04-4b88-b9e8-d19344df56eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:46 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Volume volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99 (3384c807-5ac5-460d-b5c4-a24e2fe9da99): created successfully Sep 07 02:23:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93959eab-ea04-4b88-b9e8-d19344df56eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Flow 'volume_create_manager' (54971e08-a48e-45be-819c-d00f6a80f940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:46 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8495a3fc-cde4-4b56-ac5d-6ee64fd0997b tempest-VolumesListAdminTestJSON-1107938188 None] Created volume successfully. Sep 07 02:23:48 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:23:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Flow 'volume_create_manager' (5dbbda2c-2049-4a61-90fd-3a174cb02216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe87c357-9cf5-41af-958e-47063bede251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe87c357-9cf5-41af-958e-47063bede251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2350dd90-d4a8-4e8c-a6f3-9a2090072982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b65a7a1272400dbd0ae6c05f6597bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:49Z,use_quota=True,user_id='a5625f855ab04617b09412f49de0d709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a136c5-124c-4967-9f01-8745d3953bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a136c5-124c-4967-9f01-8745d3953bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35fac12-ec7c-43ae-9049-f94d5731263c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35fac12-ec7c-43ae-9049-f94d5731263c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2350dd90-d4a8-4e8c-a6f3-9a2090072982', 'volume_name': 'volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c224be-fa80-4fac-9053-8e28a1756f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c224be-fa80-4fac-9053-8e28a1756f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a2b2a4-b7e4-4b2a-a7d6-19ba1748aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:49 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Volume 2350dd90-d4a8-4e8c-a6f3-9a2090072982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982', 'volume_size': 1} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2350dd90-d4a8-4e8c-a6f3-9a2090072982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b65a7a1272400dbd0ae6c05f6597bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:49Z,use_quota=True,user_id='a5625f855ab04617b09412f49de0d709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Creating volume 2350dd90-d4a8-4e8c-a6f3-9a2090072982 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:23:49 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:23:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:49 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982 1073741824 Sep 07 02:23:49 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:50 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982 1073741824" returned: 0 in 1.229s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:50 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982 Sep 07 02:23:50 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:50 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982" returned: 0 in 0.362s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:23:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a2b2a4-b7e4-4b2a-a7d6-19ba1748aad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95984533-35af-460c-a54a-988e875331c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:50 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Volume volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982 (2350dd90-d4a8-4e8c-a6f3-9a2090072982): created successfully Sep 07 02:23:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95984533-35af-460c-a54a-988e875331c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Flow 'volume_create_manager' (5dbbda2c-2049-4a61-90fd-3a174cb02216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3887d03b-44b5-4946-b747-f763ddb84edf tempest-VolumesListAdminTestJSON-1622419462 None] Created volume successfully. Sep 07 02:23:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Acquiring lock "cinder-2350dd90-d4a8-4e8c-a6f3-9a2090072982-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:23:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Lock "cinder-2350dd90-d4a8-4e8c-a6f3-9a2090072982-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:23:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Acquiring lock "cinder-quobyte-2350dd90-d4a8-4e8c-a6f3-9a2090072982" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:23:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Lock "cinder-quobyte-2350dd90-d4a8-4e8c-a6f3-9a2090072982" acquired by "delete_volume" :: waited 0.074s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:23:52 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[423230aa-6295-415a-96f2-c4ce461c1d37]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:23:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "cinder-3384c807-5ac5-460d-b5c4-a24e2fe9da99-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:23:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-3384c807-5ac5-460d-b5c4-a24e2fe9da99-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:23:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "cinder-quobyte-3384c807-5ac5-460d-b5c4-a24e2fe9da99" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:23:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-quobyte-3384c807-5ac5-460d-b5c4-a24e2fe9da99" acquired by "delete_volume" :: waited 0.047s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:23:53 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0cd2cc-c78d-401a-87e7-0244a7c62239]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:23:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:53 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982 Sep 07 02:23:53 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:53 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99 Sep 07 02:23:53 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:53 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982" returned: 0 in 0.975s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:53 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982 Sep 07 02:23:53 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Flow 'volume_create_manager' (9c281ec6-1a75-4061-a75c-48fd0c83507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbdfa2e7-6ad9-4963-af2a-896279e6faea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbdfa2e7-6ad9-4963-af2a-896279e6faea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-150855402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c02252-2e4d-4e85-9498-a404af011232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da82a125ace4fc5a7007cf7b252422c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:54Z,use_quota=True,user_id='b3a6bd8a13b34eaa8bc2a8352fdc246b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9127e5-bb7e-453c-afb4-32baa3e58e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9127e5-bb7e-453c-afb4-32baa3e58e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efeb143-8cb7-428e-9c10-41d63166bf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.image.glance [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Creating Keystone auth plugin from conf {{(pid=87313) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 02:23:54 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99" returned: 0 in 1.184s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:54 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99 Sep 07 02:23:54 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:54 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-2350dd90-d4a8-4e8c-a6f3-9a2090072982" returned: 0 in 0.717s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Lock "cinder-quobyte-2350dd90-d4a8-4e8c-a6f3-9a2090072982" released by "delete_volume" :: held 1.838s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Created reservations ['96f58853-5d57-42af-8ed5-416961e29ed2', '06b5dfb5-f1b6-4256-85f0-d7f43a39ae11', 'c57646b9-8886-418e-b5c4-005d84e8b686', 'cd0fe3a4-2eed-4324-a822-0ff1b83e9bc6'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:55 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:23:55 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:55 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3384c807-5ac5-460d-b5c4-a24e2fe9da99" returned: 0 in 0.883s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-quobyte-3384c807-5ac5-460d-b5c4-a24e2fe9da99" released by "delete_volume" :: held 2.178s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efeb143-8cb7-428e-9c10-41d63166bf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22c02252-2e4d-4e85-9498-a404af011232', 'volume_name': 'volume-22c02252-2e4d-4e85-9498-a404af011232', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3557ea5a-bf30-4876-9cfa-4fbf7a55de55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:55 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3557ea5a-bf30-4876-9cfa-4fbf7a55de55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2f8d05-cf58-4b59-b6a9-8bd065995738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:23:55 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Volume 22c02252-2e4d-4e85-9498-a404af011232: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22c02252-2e4d-4e85-9498-a404af011232', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Trying to clone 22c02252-2e4d-4e85-9498-a404af011232 from image 923d33a7-8f5b-413a-bd44-620eb1f09c8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]). {{(pid=87313) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.598s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:23:55 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Deleted volume successfully. Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Created reservations ['44f525d7-b105-4c27-a673-7dca989c8ed0', '9f1278b0-5a09-4287-8906-90bae4f9358e', '70eba28c-0bc3-4e69-bab3-c384d1c70043', 'cbc40203-6449-4288-baac-e035da44c94c'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8ea911b5-d4de-42b6-a0f1-ef2b2ce57259 tempest-VolumesListAdminTestJSON-1622419462 None] Lock "cinder-2350dd90-d4a8-4e8c-a6f3-9a2090072982-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:56 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:23:56 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 02:23:56 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Image download 20.69 MB at 20.69 MB/s Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eae5191-b92d-4063-9b17-f829990ea9d9]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:56 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD Sep 07 02:23:56 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:56 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Temporary image 923d33a7-8f5b-413a-bd44-620eb1f09c8b is fetched for user b3a6bd8a13b34eaa8bc2a8352fdc246b. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 02:23:56 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.825s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:23:56 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Deleted volume successfully. Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "cinder-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[97342c65-1b01-4861-8893-717d779c158e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-64b71dc7-fe63-4df5-8e3b-ca283d73c17c tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-3384c807-5ac5-460d-b5c4-a24e2fe9da99-delete_volume" released by "delete_volume" :: held 4.005s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:23:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "cinder-quobyte-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-quobyte-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3" acquired by "delete_volume" :: waited 0.078s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2193737-76eb-49c7-9c58-c2c42fdb5938]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:57 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3 Sep 07 02:23:57 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:57 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD Sep 07 02:23:57 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:57 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3" returned: 0 in 0.551s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:57 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD" returned: 0 in 0.834s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-150855402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c02252-2e4d-4e85-9498-a404af011232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da82a125ace4fc5a7007cf7b252422c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:23:54Z,use_quota=True,user_id='b3a6bd8a13b34eaa8bc2a8352fdc246b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Creating volume 22c02252-2e4d-4e85-9498-a404af011232 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:57 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3 Sep 07 02:23:57 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:23:57 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:23:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:57 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 1073741824 Sep 07 02:23:57 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:58 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3" returned: 0 in 0.318s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-quobyte-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3" released by "delete_volume" :: held 0.936s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Created reservations ['1940888c-4dbf-422a-8612-404985eef496', 'f446797d-9cc8-419a-bb20-1e22642254ee', '908ffca7-212b-46d1-8605-e2e488893268', '54604b7c-c715-42ae-8e2c-2a5770ba4051'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:58 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:23:58 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:58 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 1073741824" returned: 0 in 0.637s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:58 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 Sep 07 02:23:58 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:58 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.298s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:23:58 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Deleted volume successfully. Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-49f12ae2-9189-48ac-beef-dbcfe0bb003b tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-940bb4ed-c7a5-4c18-a6e5-a4a145d9c7a3-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:23:58 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232" returned: 0 in 0.349s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Attempting download of 923d33a7-8f5b-413a-bd44-620eb1f09c8b ((None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}])) to volume 22c02252-2e4d-4e85-9498-a404af011232. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b18498-c8d3-4514-99ca-257dcc6ed35b]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:23:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z9np2zj9 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:59 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z9np2zj9 Sep 07 02:23:59 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:59 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z9np2zj9" returned: 0 in 0.349s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z9np2zj9 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:59 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z9np2zj9 Sep 07 02:23:59 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "cinder-3bf78f9c-17c0-4a97-80e9-a99b20e24238-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-3bf78f9c-17c0-4a97-80e9-a99b20e24238-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "cinder-quobyte-3bf78f9c-17c0-4a97-80e9-a99b20e24238" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:23:59 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-quobyte-3bf78f9c-17c0-4a97-80e9-a99b20e24238" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z9np2zj9" returned: 1 in 0.419s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z9np2zj9' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba255ad-a1dc-4b5a-be00-3af82475a26d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[9500d261-096a-45bc-896d-c713368fb493]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:23:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:23:59 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238 Sep 07 02:23:59 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:23:59 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD Sep 07 02:23:59 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:00 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238" returned: 0 in 0.398s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:00 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238 Sep 07 02:24:00 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:00 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] 923d33a7-8f5b-413a-bd44-620eb1f09c8b was qcow2, converting to qcow2 {{(pid=87313) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:00 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 Sep 07 02:24:00 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:00 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3bf78f9c-17c0-4a97-80e9-a99b20e24238" returned: 0 in 0.363s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-quobyte-3bf78f9c-17c0-4a97-80e9-a99b20e24238" released by "delete_volume" :: held 0.818s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Created reservations ['bed5583a-37bd-4575-905c-373eaf41e1ac', '8ceff3fa-43b7-4345-a827-bff68557bc23', '7602a29b-0118-4ac1-962a-72fe9e99607f', 'fc233eac-87d4-4c46-8546-942786fd5740'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:00 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:24:00 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:01 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.282s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:01 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:24:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Deleted volume successfully. Sep 07 02:24:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f97c3a3f-b9ff-4a74-855c-5ebdcd52fa21 tempest-VolumesListAdminTestJSON-1107938188 None] Lock "cinder-3bf78f9c-17c0-4a97-80e9-a99b20e24238-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:02 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232" returned: 0 in 2.496s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:02 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_y5b49fxidevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:24:02 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Converted 112.00 MB image at 44.85 MB/s Sep 07 02:24:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:02 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 1G Sep 07 02:24:02 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:03 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 1G" returned: 0 in 0.429s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:03 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Downloaded image 923d33a7-8f5b-413a-bd44-620eb1f09c8b ((None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}])) to volume 22c02252-2e4d-4e85-9498-a404af011232 successfully. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 02:24:03 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Temporary image 923d33a7-8f5b-413a-bd44-620eb1f09c8b for user b3a6bd8a13b34eaa8bc2a8352fdc246b is deleted. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 02:24:03 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Marking volume 22c02252-2e4d-4e85-9498-a404af011232 as bootable. {{(pid=87313) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 02:24:03 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Copying metadata from image 923d33a7-8f5b-413a-bd44-620eb1f09c8b to 22c02252-2e4d-4e85-9498-a404af011232. {{(pid=87313) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 02:24:03 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Creating volume glance metadata for volume 22c02252-2e4d-4e85-9498-a404af011232 backed by image 923d33a7-8f5b-413a-bd44-620eb1f09c8b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87313) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 02:24:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2f8d05-cf58-4b59-b6a9-8bd065995738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c02252-2e4d-4e85-9498-a404af011232', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1e5d87-1fe7-4ae4-8cdd-47ea7777a98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:03 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Volume volume-22c02252-2e4d-4e85-9498-a404af011232 (22c02252-2e4d-4e85-9498-a404af011232): created successfully Sep 07 02:24:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1e5d87-1fe7-4ae4-8cdd-47ea7777a98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Flow 'volume_create_manager' (9c281ec6-1a75-4061-a75c-48fd0c83507f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:03 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e02f3093-736c-4960-843e-318be1b83bd5 tempest-TestShelveInstance-1433916678 None] Created volume successfully. Sep 07 02:24:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-13120256-26bc-422f-89ff-4e017604097e req-74f305ed-555d-423a-b816-ab043706363c tempest-TestShelveInstance-1433916678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-13120256-26bc-422f-89ff-4e017604097e req-74f305ed-555d-423a-b816-ab043706363c tempest-TestShelveInstance-1433916678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-13120256-26bc-422f-89ff-4e017604097e req-74f305ed-555d-423a-b816-ab043706363c tempest-TestShelveInstance-1433916678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-13120256-26bc-422f-89ff-4e017604097e req-74f305ed-555d-423a-b816-ab043706363c tempest-TestShelveInstance-1433916678 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-22c02252-2e4d-4e85-9498-a404af011232', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ecf263a-f108-42c3-87ff-baf302f2a52d', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:24:06 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-13120256-26bc-422f-89ff-4e017604097e req-74f305ed-555d-423a-b816-ab043706363c tempest-TestShelveInstance-1433916678 None] attachment_update completed successfully. Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Flow 'volume_create_manager' (60c344ed-3e69-488b-b198-07269844738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f50858-978c-4aab-b9e4-fd5c1fa9fa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f50858-978c-4aab-b9e4-fd5c1fa9fa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-69120293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd52cd9-548b-410d-acf8-03799b90d30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f546a841032f4f12acfc879f33d24489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:08Z,use_quota=True,user_id='10d6970ed51f4385ad0767ff47adffdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a671ae91-35a3-475b-a420-e63ec715c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a671ae91-35a3-475b-a420-e63ec715c13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858900f9-eede-433d-84bc-44a28eebf4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858900f9-eede-433d-84bc-44a28eebf4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd52cd9-548b-410d-acf8-03799b90d30d', 'volume_name': 'volume-9dd52cd9-548b-410d-acf8-03799b90d30d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e08b091-3f96-4bfc-9434-31f7375d1157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e08b091-3f96-4bfc-9434-31f7375d1157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d2d11a-f72d-4301-b8db-14d29303d241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:08 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Volume 9dd52cd9-548b-410d-acf8-03799b90d30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd52cd9-548b-410d-acf8-03799b90d30d', 'volume_size': 1} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-69120293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd52cd9-548b-410d-acf8-03799b90d30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f546a841032f4f12acfc879f33d24489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:08Z,use_quota=True,user_id='10d6970ed51f4385ad0767ff47adffdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Creating volume 9dd52cd9-548b-410d-acf8-03799b90d30d {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:24:08 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:24:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:08 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d 1073741824 Sep 07 02:24:08 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:09 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d 1073741824" returned: 0 in 0.708s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:09 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d Sep 07 02:24:09 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:09 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d" returned: 0 in 0.560s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:24:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d2d11a-f72d-4301-b8db-14d29303d241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd52cd9-548b-410d-acf8-03799b90d30d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1ec9c2-bc0a-4c65-a144-1a8841fdc33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:09 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Volume volume-9dd52cd9-548b-410d-acf8-03799b90d30d (9dd52cd9-548b-410d-acf8-03799b90d30d): created successfully Sep 07 02:24:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1ec9c2-bc0a-4c65-a144-1a8841fdc33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Flow 'volume_create_manager' (60c344ed-3e69-488b-b198-07269844738e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:09 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7127b854-1144-4a7f-b487-891e6da60cfa tempest-VolumesTransfersTest-39833380 None] Created volume successfully. Sep 07 02:24:11 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5f9d8dd0-32c1-43ba-8269-dd1a5e1c9e25 tempest-VolumesTransfersTest-1071434973 None] Transfer volume completed successfully. Sep 07 02:24:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Acquiring lock "cinder-9dd52cd9-548b-410d-acf8-03799b90d30d-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Lock "cinder-9dd52cd9-548b-410d-acf8-03799b90d30d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Acquiring lock "cinder-quobyte-9dd52cd9-548b-410d-acf8-03799b90d30d" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Lock "cinder-quobyte-9dd52cd9-548b-410d-acf8-03799b90d30d" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:12 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f291ba6e-c075-4abc-b29f-b6b17f16a7f1]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:24:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:12 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d Sep 07 02:24:12 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:12 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d" returned: 0 in 0.447s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:12 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d Sep 07 02:24:12 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:13 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9dd52cd9-548b-410d-acf8-03799b90d30d" returned: 0 in 0.301s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Lock "cinder-quobyte-9dd52cd9-548b-410d-acf8-03799b90d30d" released by "delete_volume" :: held 0.795s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Created reservations ['ece4d6aa-4aa7-486d-9240-04775d300227', 'f2091953-9db9-414f-97f5-43d593edc8ab', 'b1c8af01-3a9f-4f9d-9f3e-d75e6aace4c6', 'f54f81ef-4107-48c6-868f-f00ccf2d3b22'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:13 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:24:13 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:13 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.472s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:24:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Deleted volume successfully. Sep 07 02:24:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67cfbc33-0257-4f2f-859f-1ab87277dfd2 tempest-VolumesTransfersTest-1482784924 None] Lock "cinder-9dd52cd9-548b-410d-acf8-03799b90d30d-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Flow 'volume_create_manager' (6b83203e-93b5-4f4c-9bd8-7d559673bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8831e6b8-1d82-46c2-9526-5df8a35db8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8831e6b8-1d82-46c2-9526-5df8a35db8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-624861062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3150da7b-6e05-467f-a491-bb1dfff4a9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b9fc35a72042f4ab6cc6549c6e7ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:14Z,use_quota=True,user_id='acf95621ba6f4b35ae9582fa8bf4ea3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059482ce-3806-48f2-ad0c-657ffa156fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059482ce-3806-48f2-ad0c-657ffa156fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea4cf34-6a81-4593-9d75-900b1b5a83e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea4cf34-6a81-4593-9d75-900b1b5a83e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3150da7b-6e05-467f-a491-bb1dfff4a9a1', 'volume_name': 'volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1776a23b-6cfc-4d59-9855-4536fe37d84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1776a23b-6cfc-4d59-9855-4536fe37d84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b8ebca-0145-499a-9a05-ccf51752b657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:14 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Volume 3150da7b-6e05-467f-a491-bb1dfff4a9a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1', 'volume_size': 1} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-624861062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3150da7b-6e05-467f-a491-bb1dfff4a9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b9fc35a72042f4ab6cc6549c6e7ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:14Z,use_quota=True,user_id='acf95621ba6f4b35ae9582fa8bf4ea3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Creating volume 3150da7b-6e05-467f-a491-bb1dfff4a9a1 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:24:14 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:24:14 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1 1073741824 Sep 07 02:24:14 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Flow 'volume_create_manager' (16c646cf-f982-420e-be8d-b36bb6c503d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c26dec3-42d9-43fe-aa96-f2ae854646ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c26dec3-42d9-43fe-aa96-f2ae854646ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-701370762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f96888b-19ac-45c9-826a-e579a2d45662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f546a841032f4f12acfc879f33d24489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:15Z,use_quota=True,user_id='10d6970ed51f4385ad0767ff47adffdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e90fe68-9b77-4c38-9682-2791fd476c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e90fe68-9b77-4c38-9682-2791fd476c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9990c82-f635-4406-9ae8-86f73acb8279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9990c82-f635-4406-9ae8-86f73acb8279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f96888b-19ac-45c9-826a-e579a2d45662', 'volume_name': 'volume-7f96888b-19ac-45c9-826a-e579a2d45662', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888cc608-597d-4083-b63e-33042c0e6322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888cc608-597d-4083-b63e-33042c0e6322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9dc54c-97ff-4446-a805-1efcdb17326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:14 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Volume 7f96888b-19ac-45c9-826a-e579a2d45662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f96888b-19ac-45c9-826a-e579a2d45662', 'volume_size': 1} Sep 07 02:24:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:15 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1 1073741824" returned: 0 in 0.653s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:15 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1 Sep 07 02:24:15 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:15 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1" returned: 0 in 0.298s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-701370762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f96888b-19ac-45c9-826a-e579a2d45662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f546a841032f4f12acfc879f33d24489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:15Z,use_quota=True,user_id='10d6970ed51f4385ad0767ff47adffdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Creating volume 7f96888b-19ac-45c9-826a-e579a2d45662 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:24:15 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b8ebca-0145-499a-9a05-ccf51752b657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab49f7b-034b-4899-ba1f-355c2b707823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:15 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662 1073741824 Sep 07 02:24:15 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:15 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Volume volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1 (3150da7b-6e05-467f-a491-bb1dfff4a9a1): created successfully Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab49f7b-034b-4899-ba1f-355c2b707823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Flow 'volume_create_manager' (6b83203e-93b5-4f4c-9bd8-7d559673bce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:15 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2840f0ee-5815-45a3-a077-57de1500d926 tempest-AttachVolumeNegativeTest-1020865030 None] Created volume successfully. Sep 07 02:24:16 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662 1073741824" returned: 0 in 0.850s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:16 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662 Sep 07 02:24:16 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:17 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662" returned: 0 in 0.537s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9dc54c-97ff-4446-a805-1efcdb17326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f96888b-19ac-45c9-826a-e579a2d45662', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba00f783-828e-4ec2-8029-7307d0dc2359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:17 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Volume volume-7f96888b-19ac-45c9-826a-e579a2d45662 (7f96888b-19ac-45c9-826a-e579a2d45662): created successfully Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba00f783-828e-4ec2-8029-7307d0dc2359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Flow 'volume_create_manager' (16c646cf-f982-420e-be8d-b36bb6c503d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:17 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6048c695-501b-41ed-abf9-e567524be17c tempest-VolumesTransfersTest-39833380 None] Created volume successfully. Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-8d02b4c2-2e6a-4964-a46b-11ecb2b70727 req-8ed9a5e3-6bdf-4ae0-a4a5-66d270f2ed0c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-8d02b4c2-2e6a-4964-a46b-11ecb2b70727 req-8ed9a5e3-6bdf-4ae0-a4a5-66d270f2ed0c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-8d02b4c2-2e6a-4964-a46b-11ecb2b70727 req-8ed9a5e3-6bdf-4ae0-a4a5-66d270f2ed0c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-8d02b4c2-2e6a-4964-a46b-11ecb2b70727 req-8ed9a5e3-6bdf-4ae0-a4a5-66d270f2ed0c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7e4df7a-8810-43bc-88ef-69618aea88c3', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:24:17 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-8d02b4c2-2e6a-4964-a46b-11ecb2b70727 req-8ed9a5e3-6bdf-4ae0-a4a5-66d270f2ed0c tempest-TestServerVolumeAttachmentScenario-1701770427 None] attachment_update completed successfully. Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-c87c7803-0b11-4fc9-9354-3b41273b0a71 req-35b56a1b-c183-4b04-9fb3-c0582eaf6406 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-c87c7803-0b11-4fc9-9354-3b41273b0a71 req-35b56a1b-c183-4b04-9fb3-c0582eaf6406 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-c87c7803-0b11-4fc9-9354-3b41273b0a71 req-35b56a1b-c183-4b04-9fb3-c0582eaf6406 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-c87c7803-0b11-4fc9-9354-3b41273b0a71 req-35b56a1b-c183-4b04-9fb3-c0582eaf6406 tempest-AttachVolumeNegativeTest-1020865030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60eb7f29-d307-464f-ad81-c1239d4776cc', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:24:18 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-c87c7803-0b11-4fc9-9354-3b41273b0a71 req-35b56a1b-c183-4b04-9fb3-c0582eaf6406 tempest-AttachVolumeNegativeTest-1020865030 None] attachment_update completed successfully. Sep 07 02:24:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Acquiring lock "cinder-7f96888b-19ac-45c9-826a-e579a2d45662-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Lock "cinder-7f96888b-19ac-45c9-826a-e579a2d45662-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Acquiring lock "cinder-quobyte-7f96888b-19ac-45c9-826a-e579a2d45662" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Lock "cinder-quobyte-7f96888b-19ac-45c9-826a-e579a2d45662" acquired by "delete_volume" :: waited 0.033s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:18 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[374784c5-ca7c-4524-b60d-65046a033031]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:24:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:18 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662 Sep 07 02:24:18 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:19 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662" returned: 0 in 0.529s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:19 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662 Sep 07 02:24:19 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:19 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7f96888b-19ac-45c9-826a-e579a2d45662" returned: 0 in 0.262s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Lock "cinder-quobyte-7f96888b-19ac-45c9-826a-e579a2d45662" released by "delete_volume" :: held 0.857s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Created reservations ['895059e2-4c86-499e-b9ca-6d5c522ec6fb', 'b31469d9-4d44-457a-8323-877e1ed81970', 'd58a0330-a6c3-4298-88fa-1cf90df2e9b2', '529ca8ed-3b96-4851-9b00-5fb9a17f7fb7'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:19 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:24:19 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:19 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.437s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:24:19 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Deleted volume successfully. Sep 07 02:24:19 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4c80e78a-a3c4-4b80-9aa5-175e31b01ff6 tempest-VolumesTransfersTest-1482784924 None] Lock "cinder-7f96888b-19ac-45c9-826a-e579a2d45662-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-efbc6e3e-2447-48df-8fc0-a2018b496478 req-28ba0fe6-1b8f-491a-8cef-14bca21da0d8 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-efbc6e3e-2447-48df-8fc0-a2018b496478 req-28ba0fe6-1b8f-491a-8cef-14bca21da0d8 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-efbc6e3e-2447-48df-8fc0-a2018b496478 req-28ba0fe6-1b8f-491a-8cef-14bca21da0d8 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-efbc6e3e-2447-48df-8fc0-a2018b496478 req-28ba0fe6-1b8f-491a-8cef-14bca21da0d8 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e0b1b39-9ff8-4bc5-bcc0-ba0210ac660b', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:24:25 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-efbc6e3e-2447-48df-8fc0-a2018b496478 req-28ba0fe6-1b8f-491a-8cef-14bca21da0d8 tempest-TestServerVolumeAttachmentScenario-1701770427 None] attachment_update completed successfully. Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:26 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:24:26 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:26 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.444s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:24:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:24:28 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-09a204b1-47c0-4255-973d-e4a7c4fab9cb req-9460c4aa-406f-4343-b90d-03e891596ec5 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Terminate volume connection completed successfully. Sep 07 02:24:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-09a204b1-47c0-4255-973d-e4a7c4fab9cb req-9460c4aa-406f-4343-b90d-03e891596ec5 tempest-TestServerVolumeAttachmentScenario-1701770427 None] Deleting attachment 1e0b1b39-9ff8-4bc5-bcc0-ba0210ac660b. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:24:30 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-1453df8e-7094-4f95-827a-6d1df62c0267 req-c5c19097-24b0-445a-9368-faeebe2c839a tempest-TestServerVolumeAttachmentScenario-1701770427 None] Terminate volume connection completed successfully. Sep 07 02:24:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-1453df8e-7094-4f95-827a-6d1df62c0267 req-c5c19097-24b0-445a-9368-faeebe2c839a tempest-TestServerVolumeAttachmentScenario-1701770427 None] Deleting attachment a7e4df7a-8810-43bc-88ef-69618aea88c3. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Flow 'volume_create_manager' (b3bb7330-5492-4dac-a9f7-709bf4011a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0fdaaa-1004-406d-a102-27bcc5328eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0fdaaa-1004-406d-a102-27bcc5328eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-993985030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da7317a-c315-44f3-9ef9-418f9386d1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9d603501784d9a9b0cf403a93d0d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:31Z,use_quota=True,user_id='8b22de487ede4557a0addbb489db558c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2067e5e2-1f7f-48e4-986a-d66368470448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2067e5e2-1f7f-48e4-986a-d66368470448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82caf180-d321-44d4-b76d-23f8fe82d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82caf180-d321-44d4-b76d-23f8fe82d539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da7317a-c315-44f3-9ef9-418f9386d1be', 'volume_name': 'volume-8da7317a-c315-44f3-9ef9-418f9386d1be', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bf705e-c9ef-44e8-8a95-38b151b0151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bf705e-c9ef-44e8-8a95-38b151b0151b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d082a8d-abef-4955-827a-ce6f0ecda3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:31 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Volume 8da7317a-c315-44f3-9ef9-418f9386d1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da7317a-c315-44f3-9ef9-418f9386d1be', 'volume_size': 1} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-993985030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da7317a-c315-44f3-9ef9-418f9386d1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9d603501784d9a9b0cf403a93d0d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:31Z,use_quota=True,user_id='8b22de487ede4557a0addbb489db558c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Creating volume 8da7317a-c315-44f3-9ef9-418f9386d1be {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:24:31 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:24:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:31 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be 1073741824 Sep 07 02:24:31 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:32 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be 1073741824" returned: 0 in 0.841s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:32 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be Sep 07 02:24:32 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:33 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be" returned: 0 in 0.411s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:24:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d082a8d-abef-4955-827a-ce6f0ecda3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da7317a-c315-44f3-9ef9-418f9386d1be', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ca7878-8f48-4859-b016-359dc733ef34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:33 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Volume volume-8da7317a-c315-44f3-9ef9-418f9386d1be (8da7317a-c315-44f3-9ef9-418f9386d1be): created successfully Sep 07 02:24:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ca7878-8f48-4859-b016-359dc733ef34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Flow 'volume_create_manager' (b3bb7330-5492-4dac-a9f7-709bf4011a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:33 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=95,cinder:SELECT=72,cinder:INSERT=20,cinder:DELETE=9 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:24:33 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2e718707-e985-4b35-b5dd-ab321cdd02f5 tempest-VolumesTransfersV357Test-1011040073 None] Created volume successfully. Sep 07 02:24:33 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=97,cinder:UPDATE=71,cinder:DELETE=6,cinder:INSERT=26 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:24:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7e9ae9c7-12a1-43a4-873d-bf00657f62e0 tempest-VolumesTransfersV357Test-1549725281 None] Transfer volume completed successfully. Sep 07 02:24:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Acquiring lock "cinder-8da7317a-c315-44f3-9ef9-418f9386d1be-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Lock "cinder-8da7317a-c315-44f3-9ef9-418f9386d1be-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Acquiring lock "cinder-quobyte-8da7317a-c315-44f3-9ef9-418f9386d1be" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Lock "cinder-quobyte-8da7317a-c315-44f3-9ef9-418f9386d1be" acquired by "delete_volume" :: waited 0.030s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:35 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92faef8-0548-4ae6-a96c-1c45beb96479]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:24:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:36 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be Sep 07 02:24:36 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:36 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be" returned: 0 in 0.558s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:36 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be Sep 07 02:24:36 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:36 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8da7317a-c315-44f3-9ef9-418f9386d1be" returned: 0 in 0.351s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Lock "cinder-quobyte-8da7317a-c315-44f3-9ef9-418f9386d1be" released by "delete_volume" :: held 0.985s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:36 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Created reservations ['910f533a-4ab8-462e-9cec-0be8d98cf43e', 'c5f95c7b-6f77-4584-b2ed-2cd2aa99e7cf', 'd4112105-db63-4dad-bfb7-6737913d2742', 'b093ee58-5714-4217-9ee8-f8b7344750a5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:37 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:24:37 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:37 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.313s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:24:37 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Deleted volume successfully. Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c4de9bde-236a-4056-b3ed-1cabf8acd346 tempest-VolumesTransfersV357Test-1527789669 None] Lock "cinder-8da7317a-c315-44f3-9ef9-418f9386d1be-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "cinder-9a52fb2b-6fb5-4288-b5f8-144a51a19a05-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "cinder-9a52fb2b-6fb5-4288-b5f8-144a51a19a05-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "cinder-quobyte-9a52fb2b-6fb5-4288-b5f8-144a51a19a05" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "cinder-quobyte-9a52fb2b-6fb5-4288-b5f8-144a51a19a05" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[883d3679-ca78-40f6-8bd9-668433e7a715]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:24:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:37 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05 Sep 07 02:24:37 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:38 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05" returned: 0 in 0.500s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:38 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05 Sep 07 02:24:38 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:38 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a52fb2b-6fb5-4288-b5f8-144a51a19a05" returned: 0 in 0.307s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "cinder-quobyte-9a52fb2b-6fb5-4288-b5f8-144a51a19a05" released by "delete_volume" :: held 0.864s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Created reservations ['1964481d-479b-45c3-b2ad-e88d14753bb5', 'd50d330e-d7a3-468d-a805-3aaafbde47a6', 'c8046958-6c13-423c-96c6-990861131a05', 'e992b03d-6887-49e1-b64b-3a2511c47a40'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:38 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:24:38 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "cinder-0a3eeb99-786f-4268-888d-fe2084a9ffb4-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "cinder-0a3eeb99-786f-4268-888d-fe2084a9ffb4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "cinder-quobyte-0a3eeb99-786f-4268-888d-fe2084a9ffb4" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "cinder-quobyte-0a3eeb99-786f-4268-888d-fe2084a9ffb4" acquired by "delete_volume" :: waited 0.039s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f7f25d-2e9c-4427-8432-7a06399cfa85]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Flow 'volume_create_manager' (26bf9c44-1e61-4cd9-ad04-dacd0cc1e8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:38 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399dbd52-4a74-4b87-a04a-8193c5230566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.356s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:24:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Deleted volume successfully. Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399dbd52-4a74-4b87-a04a-8193c5230566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1217471284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f39241-2104-47cd-892c-95eb07bea7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9d603501784d9a9b0cf403a93d0d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:39Z,use_quota=True,user_id='8b22de487ede4557a0addbb489db558c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbe8028-ea5b-43df-9609-a94d6760af36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbe8028-ea5b-43df-9609-a94d6760af36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d3ebd1-48dc-41e1-ad89-763b85cf7be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:38 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4 Sep 07 02:24:38 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d3ebd1-48dc-41e1-ad89-763b85cf7be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f39241-2104-47cd-892c-95eb07bea7ce', 'volume_name': 'volume-e0f39241-2104-47cd-892c-95eb07bea7ce', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2f993a-27ee-4452-9500-1561c9f91767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2f993a-27ee-4452-9500-1561c9f91767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6c2522-7d69-40e5-a01f-6e7c06113c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:39 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Volume e0f39241-2104-47cd-892c-95eb07bea7ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f39241-2104-47cd-892c-95eb07bea7ce', 'volume_size': 1} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1217471284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f39241-2104-47cd-892c-95eb07bea7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9d603501784d9a9b0cf403a93d0d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:39Z,use_quota=True,user_id='8b22de487ede4557a0addbb489db558c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Creating volume e0f39241-2104-47cd-892c-95eb07bea7ce {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:24:39 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c3cd85f2-a3af-45e3-bbad-0c9150ce34bb tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "cinder-9a52fb2b-6fb5-4288-b5f8-144a51a19a05-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:39 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce 1073741824 Sep 07 02:24:39 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:39 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4" returned: 0 in 0.467s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:39 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4 Sep 07 02:24:39 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:39 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce 1073741824" returned: 0 in 0.612s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:39 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0a3eeb99-786f-4268-888d-fe2084a9ffb4" returned: 0 in 0.382s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "cinder-quobyte-0a3eeb99-786f-4268-888d-fe2084a9ffb4" released by "delete_volume" :: held 0.922s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:39 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce Sep 07 02:24:39 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Created reservations ['cbc4d487-91a4-4970-897d-c32dd371cd66', 'ea9bc936-4710-40e3-8c47-4539fb616fea', 'dbacfcac-6f4a-47d8-9227-916a3979bdc1', '7ab19f90-8636-4b98-b461-4535f9e3ed74'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:39 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:24:39 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:40 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce" returned: 0 in 0.393s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:24:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6c2522-7d69-40e5-a01f-6e7c06113c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f39241-2104-47cd-892c-95eb07bea7ce', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa9db06-b36a-49a6-b602-eec6e05ad23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:40 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Volume volume-e0f39241-2104-47cd-892c-95eb07bea7ce (e0f39241-2104-47cd-892c-95eb07bea7ce): created successfully Sep 07 02:24:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa9db06-b36a-49a6-b602-eec6e05ad23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Flow 'volume_create_manager' (26bf9c44-1e61-4cd9-ad04-dacd0cc1e8ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-939dd32d-8635-4605-874e-2cb0526afc40 tempest-VolumesTransfersV357Test-1011040073 None] Created volume successfully. Sep 07 02:24:40 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.358s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:40 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:24:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Deleted volume successfully. Sep 07 02:24:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a2174d77-5c98-443c-9bc2-406b78893c9c tempest-TestServerVolumeAttachmentScenario-1701770427 None] Lock "cinder-0a3eeb99-786f-4268-888d-fe2084a9ffb4-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:41 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Acquiring lock "cinder-e0f39241-2104-47cd-892c-95eb07bea7ce-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:41 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Lock "cinder-e0f39241-2104-47cd-892c-95eb07bea7ce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:41 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Acquiring lock "cinder-quobyte-e0f39241-2104-47cd-892c-95eb07bea7ce" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:24:41 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Lock "cinder-quobyte-e0f39241-2104-47cd-892c-95eb07bea7ce" acquired by "delete_volume" :: waited 0.035s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:24:41 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f5a19e-c96a-4d5e-95a3-0987ae8f328f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:24:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:42 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce Sep 07 02:24:42 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:42 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-2e04ee6c-2de7-4ad7-b459-b5fd73140929 req-0c924d32-6a8d-4c05-935f-503c964d902b tempest-TestShelveInstance-1433916678 None] Terminate volume connection completed successfully. Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-2e04ee6c-2de7-4ad7-b459-b5fd73140929 req-0c924d32-6a8d-4c05-935f-503c964d902b tempest-TestShelveInstance-1433916678 None] Deleting attachment 8ecf263a-f108-42c3-87ff-baf302f2a52d. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:24:42 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce" returned: 0 in 0.646s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:42 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce Sep 07 02:24:42 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:42 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0f39241-2104-47cd-892c-95eb07bea7ce" returned: 0 in 0.403s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Lock "cinder-quobyte-e0f39241-2104-47cd-892c-95eb07bea7ce" released by "delete_volume" :: held 1.198s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Created reservations ['30a3f148-7e0a-427d-9f13-eb4e223ed353', '2afa80d6-db91-4fbc-ab60-0677c79ea18c', '3d275473-0bf2-431f-a157-eb5f0156d052', 'e441f962-5d7e-4a3c-84c9-da767ea51852'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:42 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:24:42 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:43 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.408s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:43 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:24:43 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Deleted volume successfully. Sep 07 02:24:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-dc02d223-ab9d-4d98-b0f5-0758f6f37583 tempest-VolumesTransfersV357Test-1527789669 None] Lock "cinder-e0f39241-2104-47cd-892c-95eb07bea7ce-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:24:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-e03e5452-7d35-437d-b903-c0731154e404 req-8b7547bd-a847-4e06-b811-652ba52f00ba tempest-TestShelveInstance-1433916678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-e03e5452-7d35-437d-b903-c0731154e404 req-8b7547bd-a847-4e06-b811-652ba52f00ba tempest-TestShelveInstance-1433916678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-e03e5452-7d35-437d-b903-c0731154e404 req-8b7547bd-a847-4e06-b811-652ba52f00ba tempest-TestShelveInstance-1433916678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-e03e5452-7d35-437d-b903-c0731154e404 req-8b7547bd-a847-4e06-b811-652ba52f00ba tempest-TestShelveInstance-1433916678 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-22c02252-2e4d-4e85-9498-a404af011232', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77b439a1-b0ce-4f9e-b4ad-2a57ff39c059', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:24:46 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-e03e5452-7d35-437d-b903-c0731154e404 req-8b7547bd-a847-4e06-b811-652ba52f00ba tempest-TestShelveInstance-1433916678 None] attachment_update completed successfully. Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Flow 'volume_create_manager' (4c9263aa-b8e4-4fc8-94fc-b0d3af05a943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60964217-aa10-420f-8580-110462496a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60964217-aa10-420f-8580-110462496a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1475964419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6d1da8-2825-4ec3-b436-9c6ee0fba240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e03f48b360405b8d79e1ce654507c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:54Z,use_quota=True,user_id='2b75420480504abca9bcdc62bf2efcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5df5ca-681c-4ba4-9fcc-22f55873d77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5df5ca-681c-4ba4-9fcc-22f55873d77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091e235d-35f9-4a70-8dc1-79b7a2ba2d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091e235d-35f9-4a70-8dc1-79b7a2ba2d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec6d1da8-2825-4ec3-b436-9c6ee0fba240', 'volume_name': 'volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0a84c1-2c1a-4261-8a68-392cf6215ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0a84c1-2c1a-4261-8a68-392cf6215ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c214cb-9079-4252-8322-acf1071ba54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:53 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Volume ec6d1da8-2825-4ec3-b436-9c6ee0fba240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240', 'volume_size': 1} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1475964419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6d1da8-2825-4ec3-b436-9c6ee0fba240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e03f48b360405b8d79e1ce654507c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:54Z,use_quota=True,user_id='2b75420480504abca9bcdc62bf2efcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Creating volume ec6d1da8-2825-4ec3-b436-9c6ee0fba240 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:24:53 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:24:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:53 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 1073741824 Sep 07 02:24:53 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:54 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 1073741824" returned: 0 in 0.881s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:54 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 Sep 07 02:24:54 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:55 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240" returned: 0 in 0.324s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:24:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:24:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c214cb-9079-4252-8322-acf1071ba54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19b3401-4d0c-4e0d-8f5b-4aad42e0fd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:55 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Volume volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 (ec6d1da8-2825-4ec3-b436-9c6ee0fba240): created successfully Sep 07 02:24:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19b3401-4d0c-4e0d-8f5b-4aad42e0fd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Flow 'volume_create_manager' (4c9263aa-b8e4-4fc8-94fc-b0d3af05a943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:55 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8fbeb1dd-e31a-435b-ab0c-d0c6fefc5010 tempest-VolumesCloneTest-1912986484 None] Created volume successfully. Sep 07 02:24:56 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:24:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Flow 'volume_create_manager' (66f92709-13a4-46ce-8bf1-34088d76de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:24:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e4c1ad-ea5a-47a6-9c63-5d138390dd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e4c1ad-ea5a-47a6-9c63-5d138390dd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1141578971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af579019-6cf1-45f9-bfba-b53b01df768d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52e03f48b360405b8d79e1ce654507c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:24:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ec6d1da8-2825-4ec3-b436-9c6ee0fba240,status='creating',terminated_at=None,updated_at=2026-09-07T00:24:57Z,use_quota=True,user_id='2b75420480504abca9bcdc62bf2efcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db00a63a-1000-4c86-bce0-f3f23569f5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db00a63a-1000-4c86-bce0-f3f23569f5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd682dd1-fce7-4301-8a29-52742d537677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd682dd1-fce7-4301-8a29-52742d537677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'af579019-6cf1-45f9-bfba-b53b01df768d', 'volume_name': 'volume-af579019-6cf1-45f9-bfba-b53b01df768d', 'volume_size': 2, 'source_volid': 'ec6d1da8-2825-4ec3-b436-9c6ee0fba240', 'source_volstatus': 'available'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f851a9-1ce3-4404-9361-10e89204946d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f851a9-1ce3-4404-9361-10e89204946d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:24:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9763fe-d473-4e8b-b76d-0175ca1c9e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:24:57 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Volume af579019-6cf1-45f9-bfba-b53b01df768d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-af579019-6cf1-45f9-bfba-b53b01df768d', 'volume_size': 2, 'source_volid': 'ec6d1da8-2825-4ec3-b436-9c6ee0fba240', 'source_volstatus': 'available'} Sep 07 02:24:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:24:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:24:57 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Cloning volume ec6d1da8-2825-4ec3-b436-9c6ee0fba240 to volume af579019-6cf1-45f9-bfba-b53b01df768d Sep 07 02:24:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Creating offline snapshot 14f400da-e955-416e-8b51-dc303279582b of volume ec6d1da8-2825-4ec3-b436-9c6ee0fba240 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:24:57 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[330550ca-18bb-4c62-8d87-9de7dfd6a853]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:24:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:57 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 Sep 07 02:24:57 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:57 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240" returned: 0 in 0.747s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:58 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b 1G Sep 07 02:24:58 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:58 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b 1G" returned: 0 in 0.684s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:58 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b Sep 07 02:24:58 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:59 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b" returned: 0 in 0.380s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:59 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b is being set with open permissions: ugo+rw Sep 07 02:24:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:59 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b Sep 07 02:24:59 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:59 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b" returned: 0 in 0.370s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:59 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.info Sep 07 02:24:59 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:24:59 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Sep 07 02:24:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.info" returned: 0 in 0.471s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:24:59 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.info is being set with open permissions: ugo+rw Sep 07 02:24:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:24:59 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.info Sep 07 02:24:59 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:00 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.info" returned: 0 in 0.285s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Acquiring lock "cinder-quobyte-af579019-6cf1-45f9-bfba-b53b01df768d" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Lock "cinder-quobyte-af579019-6cf1-45f9-bfba-b53b01df768d" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] snapshot: 14f400da-e955-416e-8b51-dc303279582b, volume: af579019-6cf1-45f9-bfba-b53b01df768d, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad489e5a-897e-4a2c-b911-7df17258b6b6]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:00 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b Sep 07 02:25:00 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:00 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b" returned: 0 in 0.403s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2c29a6-56b7-4cdc-93cc-f3b738f8474b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:00 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 Sep 07 02:25:00 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:01 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240" returned: 0 in 0.417s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:25:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:25:01 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:25:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:01 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d Sep 07 02:25:01 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:04 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-3fba7d14-a77c-4dd9-bbc7-c1047e72d973 req-042b56a2-c039-4666-ac85-78fc7f997a7b tempest-AttachVolumeNegativeTest-1020865030 None] Terminate volume connection completed successfully. Sep 07 02:25:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-3fba7d14-a77c-4dd9-bbc7-c1047e72d973 req-042b56a2-c039-4666-ac85-78fc7f997a7b tempest-AttachVolumeNegativeTest-1020865030 None] Deleting attachment 60eb7f29-d307-464f-ad81-c1239d4776cc. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:25:08 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d" returned: 0 in 7.799s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:08 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240, size 1024.00 MB, duration 7.80 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:25:08 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Converted 1024.00 MB image at 131.28 MB/s Sep 07 02:25:08 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d is being set with open permissions: ugo+rw Sep 07 02:25:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:09 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d Sep 07 02:25:09 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:09 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d" returned: 0 in 0.322s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Lock "cinder-quobyte-af579019-6cf1-45f9-bfba-b53b01df768d" released by "_copy_volume_from_snapshot" :: held 9.034s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Acquiring lock "cinder-quobyte-14f400da-e955-416e-8b51-dc303279582b" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Lock "cinder-quobyte-14f400da-e955-416e-8b51-dc303279582b" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Deleting offline snapshot 14f400da-e955-416e-8b51-dc303279582b of volume ec6d1da8-2825-4ec3-b436-9c6ee0fba240 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:25:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] snapshot_file for this snap is: volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:25:09 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[212afd95-a23f-46c3-9328-fc5cef4d8242]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:09 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b Sep 07 02:25:09 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:09 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Flow 'volume_create_manager' (cac8bf7b-5b0e-4cf5-96e1-c014c355283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f2ba61-318f-43e5-9177-e6df8298a576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f2ba61-318f-43e5-9177-e6df8298a576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6052192-682e-4e2b-aa04-6ac68fc5df27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae2ea0e23034647afdddbd9dee1d6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:10Z,use_quota=True,user_id='99a5d364923e4d8b9478d92202bc98c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d321f66-4977-4979-8209-1300c01b75ed),volume_type_id=4d321f66-4977-4979-8209-1300c01b75ed)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f35993-9a53-4ff0-8f83-364cb375bc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:10 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f35993-9a53-4ff0-8f83-364cb375bc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b90d68-ce66-4e62-90b4-fccc97455e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.image.glance [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Creating Keystone auth plugin from conf {{(pid=87313) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b" returned: 0 in 0.601s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[48869442-dade-4a16-83f1-4a007c4d2202]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:10 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 Sep 07 02:25:10 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b90d68-ce66-4e62-90b4-fccc97455e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6052192-682e-4e2b-aa04-6ac68fc5df27', 'volume_name': 'volume-c6052192-682e-4e2b-aa04-6ac68fc5df27', 'volume_size': 1, 'image_id': '64414096-280b-4894-8c46-2a8b2390aedb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64414096-280b-4894-8c46-2a8b2390aedb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '944e04455b969d9b1ed4a6c8762fdf47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dae2ea0e23034647afdddbd9dee1d6b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25041063049c07a5e92a5d8b3d6387a53f039162ab817c3fe9d63937b4df86be3a954f016d05872ada7a2a71b3102b886a5abe63345b65b53a4a055677fd465d', 'id': '64414096-280b-4894-8c46-2a8b2390aedb', 'created_at': datetime.datetime(2026, 9, 7, 0, 25, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 25, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64414096-280b-4894-8c46-2a8b2390aedb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5d592d-9968-4a7d-a19c-dbd98b28d5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5d592d-9968-4a7d-a19c-dbd98b28d5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b616cc-c923-4227-8944-d07ef1afc5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:10 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Volume c6052192-682e-4e2b-aa04-6ac68fc5df27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6052192-682e-4e2b-aa04-6ac68fc5df27', 'volume_size': 1, 'image_id': '64414096-280b-4894-8c46-2a8b2390aedb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64414096-280b-4894-8c46-2a8b2390aedb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '944e04455b969d9b1ed4a6c8762fdf47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dae2ea0e23034647afdddbd9dee1d6b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25041063049c07a5e92a5d8b3d6387a53f039162ab817c3fe9d63937b4df86be3a954f016d05872ada7a2a71b3102b886a5abe63345b65b53a4a055677fd465d', 'id': '64414096-280b-4894-8c46-2a8b2390aedb', 'created_at': datetime.datetime(2026, 9, 7, 0, 25, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 25, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64414096-280b-4894-8c46-2a8b2390aedb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Trying to clone c6052192-682e-4e2b-aa04-6ac68fc5df27 from image 64414096-280b-4894-8c46-2a8b2390aedb at location (None, [{'url': 'file:///opt/stack/data/glance/images/64414096-280b-4894-8c46-2a8b2390aedb', 'metadata': {}}]). {{(pid=87313) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 02:25:10 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Image download 0.00 MB at 0.00 MB/s Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ca559b-e50d-4278-85d0-20d7e5603ccf]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:10 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240" returned: 0 in 0.601s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:10 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b Sep 07 02:25:10 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:10 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD Sep 07 02:25:10 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:11 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:11 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b" returned: 0 in 0.377s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:11 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b Sep 07 02:25:11 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:11 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD Sep 07 02:25:11 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:11 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240.14f400da-e955-416e-8b51-dc303279582b" returned: 0 in 0.276s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:11 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Temporary image 64414096-280b-4894-8c46-2a8b2390aedb is fetched for user 99a5d364923e4d8b9478d92202bc98c8. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Lock "cinder-quobyte-14f400da-e955-416e-8b51-dc303279582b" released by "_delete_snapshot" :: held 2.049s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.410s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9763fe-d473-4e8b-b76d-0175ca1c9e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af579019-6cf1-45f9-bfba-b53b01df768d', 'volume_size': 2, 'source_volid': 'ec6d1da8-2825-4ec3-b436-9c6ee0fba240', 'source_volstatus': 'available'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6090421a-464a-41bf-863a-e6aea6267b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec4da69-6259-4360-b536-2f644d117e9d]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:11 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Volume volume-af579019-6cf1-45f9-bfba-b53b01df768d (af579019-6cf1-45f9-bfba-b53b01df768d): created successfully Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6090421a-464a-41bf-863a-e6aea6267b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Flow 'volume_create_manager' (66f92709-13a4-46ce-8bf1-34088d76de8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:11 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-63d76ae5-1449-4616-9e8e-e7c6dc12bad4 tempest-VolumesCloneTest-1912986484 None] Created volume successfully. Sep 07 02:25:11 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD Sep 07 02:25:11 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:11 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:12 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD Sep 07 02:25:12 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Acquiring lock "cinder-af579019-6cf1-45f9-bfba-b53b01df768d-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Lock "cinder-af579019-6cf1-45f9-bfba-b53b01df768d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Acquiring lock "cinder-quobyte-af579019-6cf1-45f9-bfba-b53b01df768d" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Lock "cinder-quobyte-af579019-6cf1-45f9-bfba-b53b01df768d" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:12 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6052192-682e-4e2b-aa04-6ac68fc5df27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae2ea0e23034647afdddbd9dee1d6b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:10Z,use_quota=True,user_id='99a5d364923e4d8b9478d92202bc98c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d321f66-4977-4979-8209-1300c01b75ed),volume_type_id=4d321f66-4977-4979-8209-1300c01b75ed)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Creating volume c6052192-682e-4e2b-aa04-6ac68fc5df27 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:12 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[b696b6b7-3ca9-40fc-bba6-44f23533db98]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:12 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 1073741824 Sep 07 02:25:12 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:12 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d Sep 07 02:25:12 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:12 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d" returned: 0 in 0.439s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:12 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d Sep 07 02:25:12 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:12 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 1073741824" returned: 0 in 0.510s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:12 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 Sep 07 02:25:12 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:13 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af579019-6cf1-45f9-bfba-b53b01df768d" returned: 0 in 0.306s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Lock "cinder-quobyte-af579019-6cf1-45f9-bfba-b53b01df768d" released by "delete_volume" :: held 0.810s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:13 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27" returned: 0 in 0.287s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Created reservations ['f2f513cd-15ce-4b0e-be0a-4f209f4d99b4', 'bb915822-5c4b-4005-9380-550a7d30cb3b', 'd4842398-f7ed-4f4b-9e87-0129ad032e2f', 'f813eb0d-cfdc-4404-80d0-52ba7e023dd5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Attempting download of 64414096-280b-4894-8c46-2a8b2390aedb ((None, [{'url': 'file:///opt/stack/data/glance/images/64414096-280b-4894-8c46-2a8b2390aedb', 'metadata': {}}])) to volume c6052192-682e-4e2b-aa04-6ac68fc5df27. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d428dd-4937-4b44-b6c2-ccf7de7641f4]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64414096-280b-4894-8c46-2a8b2390aedb_ftq88yb5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:13 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:13 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:13 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64414096-280b-4894-8c46-2a8b2390aedb_ftq88yb5 Sep 07 02:25:13 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Acquiring lock "cinder-ec6d1da8-2825-4ec3-b436-9c6ee0fba240-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Lock "cinder-ec6d1da8-2825-4ec3-b436-9c6ee0fba240-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Acquiring lock "cinder-quobyte-ec6d1da8-2825-4ec3-b436-9c6ee0fba240" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Lock "cinder-quobyte-ec6d1da8-2825-4ec3-b436-9c6ee0fba240" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:13 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.338s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Deleted volume successfully. Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3981f93-b3ae-4e68-8a6f-9798c6a8bf6b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4485480c-4bde-41bd-86c8-d9e519bb190a tempest-VolumesCloneTest-1912986484 None] Lock "cinder-af579019-6cf1-45f9-bfba-b53b01df768d-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:13 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64414096-280b-4894-8c46-2a8b2390aedb_ftq88yb5" returned: 0 in 0.458s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64414096-280b-4894-8c46-2a8b2390aedb_ftq88yb5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:13 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 Sep 07 02:25:13 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:13 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64414096-280b-4894-8c46-2a8b2390aedb_ftq88yb5 Sep 07 02:25:13 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:13 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240" returned: 0 in 0.393s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:14 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240 Sep 07 02:25:14 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:14 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64414096-280b-4894-8c46-2a8b2390aedb_ftq88yb5" returned: 1 in 0.348s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64414096-280b-4894-8c46-2a8b2390aedb_ftq88yb5' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[75867cf3-d041-46e6-8524-1b05d54cc30b]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:14 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD Sep 07 02:25:14 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:14 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ec6d1da8-2825-4ec3-b436-9c6ee0fba240" returned: 0 in 0.290s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Lock "cinder-quobyte-ec6d1da8-2825-4ec3-b436-9c6ee0fba240" released by "delete_volume" :: held 0.770s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Created reservations ['bf46afc9-fcfc-4f7c-8cc9-6a8daee6c157', 'df19b9d0-535b-4e9f-b4ea-c60cf3c161be', 'b1a09995-1bb5-4cfc-908a-40830d2a3e5f', 'db2ef71e-f8d9-44fb-a0eb-fa3184a3c0e9'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:25:14 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:14 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:14 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:14 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD Sep 07 02:25:14 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:14 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.320s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:14 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Deleted volume successfully. Sep 07 02:25:14 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e3b5afd7-8d6f-4191-9f63-ed2a72dc551f tempest-VolumesCloneTest-1912986484 None] Lock "cinder-ec6d1da8-2825-4ec3-b436-9c6ee0fba240-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD" returned: 1 in 0.452s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] 64414096-280b-4894-8c46-2a8b2390aedb was raw, converting to qcow2 {{(pid=87313) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 02:25:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:14 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 Sep 07 02:25:14 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:15 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27" returned: 0 in 0.565s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:15 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64414096-280b-4894-8c46-2a8b2390aedb_me30e5z8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:25:15 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 02:25:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:15 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 1G Sep 07 02:25:15 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:15 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 1G" returned: 0 in 0.466s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:15 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Downloaded image 64414096-280b-4894-8c46-2a8b2390aedb ((None, [{'url': 'file:///opt/stack/data/glance/images/64414096-280b-4894-8c46-2a8b2390aedb', 'metadata': {}}])) to volume c6052192-682e-4e2b-aa04-6ac68fc5df27 successfully. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 02:25:15 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Temporary image 64414096-280b-4894-8c46-2a8b2390aedb for user 99a5d364923e4d8b9478d92202bc98c8 is deleted. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 02:25:15 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Marking volume c6052192-682e-4e2b-aa04-6ac68fc5df27 as bootable. {{(pid=87313) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 02:25:15 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Copying metadata from image 64414096-280b-4894-8c46-2a8b2390aedb to c6052192-682e-4e2b-aa04-6ac68fc5df27. {{(pid=87313) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 02:25:15 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Creating volume glance metadata for volume c6052192-682e-4e2b-aa04-6ac68fc5df27 backed by image 64414096-280b-4894-8c46-2a8b2390aedb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '64414096-280b-4894-8c46-2a8b2390aedb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '944e04455b969d9b1ed4a6c8762fdf47', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87313) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 02:25:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b616cc-c923-4227-8944-d07ef1afc5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6052192-682e-4e2b-aa04-6ac68fc5df27', 'volume_size': 1, 'image_id': '64414096-280b-4894-8c46-2a8b2390aedb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64414096-280b-4894-8c46-2a8b2390aedb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '944e04455b969d9b1ed4a6c8762fdf47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dae2ea0e23034647afdddbd9dee1d6b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25041063049c07a5e92a5d8b3d6387a53f039162ab817c3fe9d63937b4df86be3a954f016d05872ada7a2a71b3102b886a5abe63345b65b53a4a055677fd465d', 'id': '64414096-280b-4894-8c46-2a8b2390aedb', 'created_at': datetime.datetime(2026, 9, 7, 0, 25, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 25, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64414096-280b-4894-8c46-2a8b2390aedb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d4ae54-9480-4a2b-8928-883d9840656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:16 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Volume volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 (c6052192-682e-4e2b-aa04-6ac68fc5df27): created successfully Sep 07 02:25:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d4ae54-9480-4a2b-8928-883d9840656c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Flow 'volume_create_manager' (cac8bf7b-5b0e-4cf5-96e1-c014c355283b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:16 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-975f4c51-6caf-457c-95ae-fcbeb62e7ef1 tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Created volume successfully. Sep 07 02:25:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Acquiring lock "cinder-c6052192-682e-4e2b-aa04-6ac68fc5df27-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Lock "cinder-c6052192-682e-4e2b-aa04-6ac68fc5df27-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Acquiring lock "cinder-quobyte-c6052192-682e-4e2b-aa04-6ac68fc5df27" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Lock "cinder-quobyte-c6052192-682e-4e2b-aa04-6ac68fc5df27" acquired by "delete_volume" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:16 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddb0df4-c966-4bb6-868a-3bc5ca03ef02]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:16 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 Sep 07 02:25:16 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:17 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27" returned: 0 in 0.521s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:17 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27 Sep 07 02:25:17 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:17 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c6052192-682e-4e2b-aa04-6ac68fc5df27" returned: 0 in 0.484s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Lock "cinder-quobyte-c6052192-682e-4e2b-aa04-6ac68fc5df27" released by "delete_volume" :: held 1.104s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:17 devstack cinder-volume[87313]: WARNING cinder.quota [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:25:17 devstack cinder-volume[87313]: WARNING cinder.quota [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:25:17 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Created reservations ['181e3cb4-b731-4238-892a-81425e7dcd30', 'ce94edc4-8dd3-49d8-81d4-f63eecbb3344', '5659042b-d421-46dd-b9bc-7e505a9df3e6', 'fb566f0b-31b3-4690-a840-4cf6b86a37f0'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:25:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:17 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:17 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:18 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.276s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:18 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:18 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Deleted volume successfully. Sep 07 02:25:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b2e879c7-780c-40c3-8f61-3ca67b63c9ad tempest-VolumeAndVolumeTypeFromImageTest-1348609934 None] Lock "cinder-c6052192-682e-4e2b-aa04-6ac68fc5df27-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Flow 'volume_create_manager' (43de6c45-3095-4814-a02c-64729dd9bcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f214a7-0ce4-494f-9125-e6ebfdcc2ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f214a7-0ce4-494f-9125-e6ebfdcc2ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290427228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97b6e53-619e-4353-8f79-841e39966dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26498ae797314477893c614961364981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:26Z,use_quota=True,user_id='196c4f752d3c4b55aa3fe480592e9d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20521446-1eff-48bd-8fcc-ebf908899950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20521446-1eff-48bd-8fcc-ebf908899950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a12b67-7aea-47ff-8b21-464b5e955bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a12b67-7aea-47ff-8b21-464b5e955bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97b6e53-619e-4353-8f79-841e39966dc1', 'volume_name': 'volume-c97b6e53-619e-4353-8f79-841e39966dc1', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c874879-3b8c-4dcb-b3e2-c2cd8cb8cc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c874879-3b8c-4dcb-b3e2-c2cd8cb8cc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff24893-6516-426d-9bbd-693b75193111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:25 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Volume c97b6e53-619e-4353-8f79-841e39966dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97b6e53-619e-4353-8f79-841e39966dc1', 'volume_size': 1} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290427228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97b6e53-619e-4353-8f79-841e39966dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26498ae797314477893c614961364981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:26Z,use_quota=True,user_id='196c4f752d3c4b55aa3fe480592e9d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Creating volume c97b6e53-619e-4353-8f79-841e39966dc1 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:25 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:25 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1 1073741824 Sep 07 02:25:25 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:26 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:26 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Flow 'volume_create_manager' (a01decfb-0da6-4563-83aa-930dc771724f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b81ac7d-9e6d-4c8e-b37f-1596e9adebb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b81ac7d-9e6d-4c8e-b37f-1596e9adebb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-680221478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5964562e-1362-417e-aca6-c009c72fd6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26498ae797314477893c614961364981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:26Z,use_quota=True,user_id='196c4f752d3c4b55aa3fe480592e9d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd825347-d964-4434-b81f-67f9d5bd81ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd825347-d964-4434-b81f-67f9d5bd81ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:26 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529667be-d6ca-47e2-81f4-56afa21471b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529667be-d6ca-47e2-81f4-56afa21471b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5964562e-1362-417e-aca6-c009c72fd6f4', 'volume_name': 'volume-5964562e-1362-417e-aca6-c009c72fd6f4', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:26 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ca1478-f7dc-4036-b522-38967ee65fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ca1478-f7dc-4036-b522-38967ee65fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a72cded-8fae-4d4f-89bf-8c42dda728f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:26 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Volume 5964562e-1362-417e-aca6-c009c72fd6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5964562e-1362-417e-aca6-c009c72fd6f4', 'volume_size': 1} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1 1073741824" returned: 0 in 1.144s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.608s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:25:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:26 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1 Sep 07 02:25:26 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Flow 'volume_create_manager' (50cdfc2a-14f6-4bff-9da5-44b88d52bbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908c4dd0-e3f4-4164-996e-f588ecb7c2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908c4dd0-e3f4-4164-996e-f588ecb7c2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-273751234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6988532d-8ddf-4896-83b0-44a9b1bb9161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26498ae797314477893c614961364981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:27Z,use_quota=True,user_id='196c4f752d3c4b55aa3fe480592e9d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aba31b1-67e5-4def-ad70-c2741787ef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aba31b1-67e5-4def-ad70-c2741787ef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8aa17e-b3e7-4b70-886c-7a97440cde48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8aa17e-b3e7-4b70-886c-7a97440cde48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6988532d-8ddf-4896-83b0-44a9b1bb9161', 'volume_name': 'volume-6988532d-8ddf-4896-83b0-44a9b1bb9161', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01940777-1cef-453a-bbfa-70886ef3de14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01940777-1cef-453a-bbfa-70886ef3de14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa26e249-601f-4976-9cd2-534d3a5b86d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:27 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Volume 6988532d-8ddf-4896-83b0-44a9b1bb9161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6988532d-8ddf-4896-83b0-44a9b1bb9161', 'volume_size': 1} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:27 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1" returned: 0 in 0.543s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-680221478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5964562e-1362-417e-aca6-c009c72fd6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26498ae797314477893c614961364981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:26Z,use_quota=True,user_id='196c4f752d3c4b55aa3fe480592e9d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Creating volume 5964562e-1362-417e-aca6-c009c72fd6f4 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:27 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff24893-6516-426d-9bbd-693b75193111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97b6e53-619e-4353-8f79-841e39966dc1', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:27 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4 1073741824 Sep 07 02:25:27 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c841901-a4ca-4932-be22-e17638375339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:27 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Volume volume-c97b6e53-619e-4353-8f79-841e39966dc1 (c97b6e53-619e-4353-8f79-841e39966dc1): created successfully Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c841901-a4ca-4932-be22-e17638375339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Flow 'volume_create_manager' (43de6c45-3095-4814-a02c-64729dd9bcad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-17a50e1f-c520-4d18-9b0b-4efb1a4f9a70 tempest-CreateVolumesFromImageTest-1170018660 None] Created volume successfully. Sep 07 02:25:27 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Flow 'volume_create_manager' (e277a298-72da-4883-a882-a991c08d10a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35cf603-a371-4fba-b0e4-2ca2efd13f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35cf603-a371-4fba-b0e4-2ca2efd13f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1618463396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26498ae797314477893c614961364981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:28Z,use_quota=True,user_id='196c4f752d3c4b55aa3fe480592e9d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50086f6-0d9b-4474-82de-6b30e398b77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50086f6-0d9b-4474-82de-6b30e398b77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd0fda8-c22b-453b-a134-59234b55c989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd0fda8-c22b-453b-a134-59234b55c989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7', 'volume_name': 'volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fc5341-34ee-45bc-bf7b-704569f4aecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fc5341-34ee-45bc-bf7b-704569f4aecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ff7dd4-47ab-4782-bce8-30e1e5ce790a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:28 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Volume d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7', 'volume_size': 1} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:28 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4 1073741824" returned: 0 in 1.127s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:28 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4 Sep 07 02:25:28 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Flow 'volume_create_manager' (581f9dcc-1581-4c89-9ad7-4123b3fb166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7877122c-367e-4bd4-83dc-caf9404acba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7877122c-367e-4bd4-83dc-caf9404acba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360668718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2aef1e-cd78-4437-be98-30671162aed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26498ae797314477893c614961364981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:29Z,use_quota=True,user_id='196c4f752d3c4b55aa3fe480592e9d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1375da2-24e4-4530-ad7f-d65d0cf0868a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1375da2-24e4-4530-ad7f-d65d0cf0868a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbc933e-7810-4553-a15c-4a05a4874a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbc933e-7810-4553-a15c-4a05a4874a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2aef1e-cd78-4437-be98-30671162aed9', 'volume_name': 'volume-fa2aef1e-cd78-4437-be98-30671162aed9', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18587250-3ac0-4da6-88c5-eb25915d2ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18587250-3ac0-4da6-88c5-eb25915d2ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa4d10b-2140-4aa4-a981-31c3fce4cd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:29 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Volume fa2aef1e-cd78-4437-be98-30671162aed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2aef1e-cd78-4437-be98-30671162aed9', 'volume_size': 1} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:29 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4" returned: 0 in 0.373s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.669s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-273751234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6988532d-8ddf-4896-83b0-44a9b1bb9161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26498ae797314477893c614961364981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:27Z,use_quota=True,user_id='196c4f752d3c4b55aa3fe480592e9d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Creating volume 6988532d-8ddf-4896-83b0-44a9b1bb9161 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:29 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a72cded-8fae-4d4f-89bf-8c42dda728f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5964562e-1362-417e-aca6-c009c72fd6f4', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:29 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161 1073741824 Sep 07 02:25:29 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4d7023-62d6-4bcc-8aea-773e5610f43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:29 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Volume volume-5964562e-1362-417e-aca6-c009c72fd6f4 (5964562e-1362-417e-aca6-c009c72fd6f4): created successfully Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4d7023-62d6-4bcc-8aea-773e5610f43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Flow 'volume_create_manager' (a01decfb-0da6-4563-83aa-930dc771724f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:29 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d2eaa6da-61f4-4713-8e94-f27d3cc3c8ff tempest-CreateVolumesFromImageTest-1170018660 None] Created volume successfully. Sep 07 02:25:29 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161 1073741824" returned: 0 in 0.760s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:29 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161 Sep 07 02:25:29 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:30 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161" returned: 0 in 0.370s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.090s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1618463396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26498ae797314477893c614961364981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:28Z,use_quota=True,user_id='196c4f752d3c4b55aa3fe480592e9d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Creating volume d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:30 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa26e249-601f-4976-9cd2-534d3a5b86d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6988532d-8ddf-4896-83b0-44a9b1bb9161', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:30 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7 1073741824 Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d79318-7204-416c-9d1e-610a889f62e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:30 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:30 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Volume volume-6988532d-8ddf-4896-83b0-44a9b1bb9161 (6988532d-8ddf-4896-83b0-44a9b1bb9161): created successfully Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d79318-7204-416c-9d1e-610a889f62e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Flow 'volume_create_manager' (50cdfc2a-14f6-4bff-9da5-44b88d52bbef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:30 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7b33d2ed-48b1-46df-9bd8-9a979489afc3 tempest-CreateVolumesFromImageTest-1170018660 None] Created volume successfully. Sep 07 02:25:31 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7 1073741824" returned: 0 in 0.717s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:31 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7 Sep 07 02:25:31 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:31 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7" returned: 0 in 0.340s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.431s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360668718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2aef1e-cd78-4437-be98-30671162aed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26498ae797314477893c614961364981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:29Z,use_quota=True,user_id='196c4f752d3c4b55aa3fe480592e9d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Creating volume fa2aef1e-cd78-4437-be98-30671162aed9 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:31 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ff7dd4-47ab-4782-bce8-30e1e5ce790a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f18b5c4-4187-498e-9cd5-8d210a488d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:31 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Volume volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7 (d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7): created successfully Sep 07 02:25:31 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9 1073741824 Sep 07 02:25:31 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f18b5c4-4187-498e-9cd5-8d210a488d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Flow 'volume_create_manager' (e277a298-72da-4883-a882-a991c08d10a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a053942c-7436-4df5-ada5-d401cb611ebf tempest-CreateVolumesFromImageTest-1170018660 None] Created volume successfully. Sep 07 02:25:32 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9 1073741824" returned: 0 in 0.904s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:32 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9 Sep 07 02:25:32 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:33 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9" returned: 0 in 0.610s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa4d10b-2140-4aa4-a981-31c3fce4cd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2aef1e-cd78-4437-be98-30671162aed9', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296b0a64-aba7-4bf5-b728-faf53b70752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=84,cinder:SELECT=63,cinder:INSERT=25,cinder:DELETE=10 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:25:33 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Volume volume-fa2aef1e-cd78-4437-be98-30671162aed9 (fa2aef1e-cd78-4437-be98-30671162aed9): created successfully Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296b0a64-aba7-4bf5-b728-faf53b70752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Flow 'volume_create_manager' (581f9dcc-1581-4c89-9ad7-4123b3fb166f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=79,cinder:INSERT=24,cinder:UPDATE=91,cinder:DELETE=5 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:25:33 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6e54171e-b8d8-4c9c-be25-99ea270262cc tempest-CreateVolumesFromImageTest-1170018660 None] Created volume successfully. Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "cinder-fa2aef1e-cd78-4437-be98-30671162aed9-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-fa2aef1e-cd78-4437-be98-30671162aed9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "cinder-quobyte-fa2aef1e-cd78-4437-be98-30671162aed9" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-quobyte-fa2aef1e-cd78-4437-be98-30671162aed9" acquired by "delete_volume" :: waited 0.033s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:34 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c9097b-42a8-485c-a518-df8c913320e0]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:34 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9 Sep 07 02:25:34 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:34 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9" returned: 0 in 0.666s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:34 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9 Sep 07 02:25:34 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:35 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fa2aef1e-cd78-4437-be98-30671162aed9" returned: 0 in 0.668s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-quobyte-fa2aef1e-cd78-4437-be98-30671162aed9" released by "delete_volume" :: held 1.412s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:35 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Created reservations ['e6c4e6fd-e663-4275-b7fb-83ebf800b8ad', '63c53d5e-9103-4cd7-a767-3b462d008130', 'f131e4c8-cfaf-4394-b7c3-bfef9e24a230', 'abf157d0-fbeb-47b7-adce-5cabcf1db174'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:25:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:35 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:35 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:36 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.453s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Deleted volume successfully. Sep 07 02:25:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-414ebed3-1c13-4fad-be4e-aee37356ecf4 tempest-TestShelveInstance-1433916678 None] Terminate volume connection completed successfully. Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-414ebed3-1c13-4fad-be4e-aee37356ecf4 tempest-TestShelveInstance-1433916678 None] Deleting attachment 77b439a1-b0ce-4f9e-b4ad-2a57ff39c059. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-31cd6f99-32fc-441a-9da0-70f40cd78123 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-fa2aef1e-cd78-4437-be98-30671162aed9-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "cinder-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "cinder-quobyte-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-quobyte-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7" acquired by "delete_volume" :: waited 0.030s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Acquiring lock "cinder-22c02252-2e4d-4e85-9498-a404af011232-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eca7c3c-076c-4384-84f8-2413321cd313]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Lock "cinder-22c02252-2e4d-4e85-9498-a404af011232-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Acquiring lock "cinder-quobyte-22c02252-2e4d-4e85-9498-a404af011232" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Lock "cinder-quobyte-22c02252-2e4d-4e85-9498-a404af011232" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf40aacf-709a-40ca-bcd2-fb410e5afff7]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:36 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7 Sep 07 02:25:36 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:36 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 Sep 07 02:25:36 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:36 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7" returned: 0 in 0.520s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:36 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7 Sep 07 02:25:36 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:37 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232" returned: 0 in 0.473s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:37 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232 Sep 07 02:25:37 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:37 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7" returned: 0 in 0.321s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-quobyte-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7" released by "delete_volume" :: held 0.919s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Created reservations ['c37c70d0-8645-42bb-a6fe-4ef40edf1f11', '41344a06-5634-4684-a082-2b2c09786471', '879c8047-85d8-4ef6-94f7-1ef1014e1749', 'c12fcc9a-183b-4a4a-8961-4f69138ea9e2'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:37 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-22c02252-2e4d-4e85-9498-a404af011232" returned: 0 in 0.394s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Lock "cinder-quobyte-22c02252-2e4d-4e85-9498-a404af011232" released by "delete_volume" :: held 0.921s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:37 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:37 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "cinder-6988532d-8ddf-4896-83b0-44a9b1bb9161-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-6988532d-8ddf-4896-83b0-44a9b1bb9161-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.quota [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Created reservations ['74ceece4-007b-4713-80b1-1bb76ea3b057', '9b68af0d-55bf-4583-b9e0-e0eff80f6a75', 'd278041e-177c-4be1-b475-fa158b3b2cd7', '6543fb3e-39c3-47ee-a695-38e4be8425b7'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "cinder-quobyte-6988532d-8ddf-4896-83b0-44a9b1bb9161" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-quobyte-6988532d-8ddf-4896-83b0-44a9b1bb9161" acquired by "delete_volume" :: waited 0.039s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[20601040-5fdd-4ee0-880c-17366604d60a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:37 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.359s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:37 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Deleted volume successfully. Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1cc4a28b-6fe1-47fc-9824-c64f9f32bf11 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-d8a6042f-4ca1-4bbd-b1e7-c11dcd7712f7-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:37 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:37 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:37 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161 Sep 07 02:25:37 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:38 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.325s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG cinder.manager [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Deleted volume successfully. Sep 07 02:25:38 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161" returned: 0 in 0.458s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-cda01aa6-51ad-4fbb-9a32-bd2fbac38837 req-9aa40a88-8556-49bc-8f70-2526bcd32f9e tempest-TestShelveInstance-1433916678 None] Lock "cinder-22c02252-2e4d-4e85-9498-a404af011232-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:38 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161 Sep 07 02:25:38 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:38 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6988532d-8ddf-4896-83b0-44a9b1bb9161" returned: 0 in 0.299s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-quobyte-6988532d-8ddf-4896-83b0-44a9b1bb9161" released by "delete_volume" :: held 0.848s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Created reservations ['13942c8e-9e6a-428c-99a1-bdda914b5f66', '32e6e98e-5aea-4c11-8009-aea2cd779c77', '94199ab5-5b9b-4c6e-94d7-765df3bcf43d', '8e7109ab-2667-4573-b45a-5798e712d690'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:38 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:38 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "cinder-5964562e-1362-417e-aca6-c009c72fd6f4-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-5964562e-1362-417e-aca6-c009c72fd6f4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "cinder-quobyte-5964562e-1362-417e-aca6-c009c72fd6f4" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-quobyte-5964562e-1362-417e-aca6-c009c72fd6f4" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e95fc6-61f9-4fdc-968a-be0938af29ea]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:39 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4 Sep 07 02:25:39 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:39 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.376s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:39 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Deleted volume successfully. Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-edc552fc-505c-4798-b3a8-b247507e7272 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-6988532d-8ddf-4896-83b0-44a9b1bb9161-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:39 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4" returned: 0 in 0.433s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:39 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4 Sep 07 02:25:39 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:39 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5964562e-1362-417e-aca6-c009c72fd6f4" returned: 0 in 0.266s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-quobyte-5964562e-1362-417e-aca6-c009c72fd6f4" released by "delete_volume" :: held 0.751s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Created reservations ['49226aa8-cc9e-4e71-aba8-336aec48e3b6', '84e764f2-97a0-4194-bb67-cb716507514d', 'ebef69cf-89f0-4b84-8db3-c8d4b4334da7', '051435fe-c2fc-4842-a81e-02280f2f7a60'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:39 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:39 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "cinder-c97b6e53-619e-4353-8f79-841e39966dc1-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-c97b6e53-619e-4353-8f79-841e39966dc1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:40 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.330s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "cinder-quobyte-c97b6e53-619e-4353-8f79-841e39966dc1" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Deleted volume successfully. Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-quobyte-c97b6e53-619e-4353-8f79-841e39966dc1" acquired by "delete_volume" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a83a6e68-99cd-40a8-920d-3659a2625907 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-5964562e-1362-417e-aca6-c009c72fd6f4-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a38a207-cb74-4318-8e6f-56e5b17085f3]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:40 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1 Sep 07 02:25:40 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:40 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1" returned: 0 in 0.454s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:40 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1 Sep 07 02:25:40 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:40 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c97b6e53-619e-4353-8f79-841e39966dc1" returned: 0 in 0.262s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-quobyte-c97b6e53-619e-4353-8f79-841e39966dc1" released by "delete_volume" :: held 0.769s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:40 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Created reservations ['7e8d4c19-c610-4754-ac6a-e159b50fb7db', '74b925b2-b8e5-47a5-b167-5a6c0fbce231', 'e9e54ddc-7c74-4ed7-9a4c-cbb437feb974', 'b3057a2b-07fe-4d9b-9c48-43ee31894306'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:25:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:41 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:41 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:41 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.255s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:41 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:41 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Deleted volume successfully. Sep 07 02:25:41 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-090cec56-b2df-4b8a-a1f3-c0071e440658 tempest-CreateVolumesFromImageTest-1170018660 None] Lock "cinder-c97b6e53-619e-4353-8f79-841e39966dc1-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (27c9221b-510a-4ea5-8880-50264068a54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8842b1d-385d-4888-bdfb-e53f4d34cffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8842b1d-385d-4888-bdfb-e53f4d34cffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445021548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f496a919-1b2b-42d6-ad86-604550b956fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:46Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d5e9a5-15a0-4b47-befd-0b5c048d75b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d5e9a5-15a0-4b47-befd-0b5c048d75b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d512b3b7-e2e1-450a-b610-97b01de1c7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d512b3b7-e2e1-450a-b610-97b01de1c7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f496a919-1b2b-42d6-ad86-604550b956fe', 'volume_name': 'volume-f496a919-1b2b-42d6-ad86-604550b956fe', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff5cd51-972d-47b3-93f8-87e552aeb4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff5cd51-972d-47b3-93f8-87e552aeb4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f0f132-4420-454d-8e56-f97850285c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:46 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume f496a919-1b2b-42d6-ad86-604550b956fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f496a919-1b2b-42d6-ad86-604550b956fe', 'volume_size': 1} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445021548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f496a919-1b2b-42d6-ad86-604550b956fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:46Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Creating volume f496a919-1b2b-42d6-ad86-604550b956fe {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:46 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:46 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe 1073741824 Sep 07 02:25:46 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:47 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe 1073741824" returned: 0 in 0.740s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:47 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe Sep 07 02:25:47 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:47 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe" returned: 0 in 0.331s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f0f132-4420-454d-8e56-f97850285c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f496a919-1b2b-42d6-ad86-604550b956fe', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bd160b-ca12-408f-b29a-741046340db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:47 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume volume-f496a919-1b2b-42d6-ad86-604550b956fe (f496a919-1b2b-42d6-ad86-604550b956fe): created successfully Sep 07 02:25:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bd160b-ca12-408f-b29a-741046340db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (27c9221b-510a-4ea5-8880-50264068a54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:47 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e8a4ab04-7eb2-4f88-8db9-cd8660790056 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created volume successfully. Sep 07 02:25:48 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (216b9e9b-7b22-4505-b0ec-d9e10230011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1689b18a-a613-427c-a35a-98b659478405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1689b18a-a613-427c-a35a-98b659478405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-539910032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306b913f-5c0e-4155-bedb-c222281bb862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:49Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527d781e-c284-40d0-8b4d-8a84d22e0f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527d781e-c284-40d0-8b4d-8a84d22e0f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bacc33-7808-4e8e-938a-af9281c6510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bacc33-7808-4e8e-938a-af9281c6510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306b913f-5c0e-4155-bedb-c222281bb862', 'volume_name': 'volume-306b913f-5c0e-4155-bedb-c222281bb862', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2f7732-47de-4084-ac0a-d26c0fd9e1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2f7732-47de-4084-ac0a-d26c0fd9e1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd338ad-6b81-498a-a297-f3b4af56a101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:49 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume 306b913f-5c0e-4155-bedb-c222281bb862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306b913f-5c0e-4155-bedb-c222281bb862', 'volume_size': 1} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-539910032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306b913f-5c0e-4155-bedb-c222281bb862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:49Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Creating volume 306b913f-5c0e-4155-bedb-c222281bb862 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:49 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:49 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862 1073741824 Sep 07 02:25:49 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (d8862103-e3ea-4e39-9f8a-c92edaa532e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323b95a2-7d19-40b1-ab5c-890ff13acef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323b95a2-7d19-40b1-ab5c-890ff13acef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1760853844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b2ce56-43d4-4eed-af10-b30dee99e236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:49Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6896338-198e-4721-a4ab-f8a4d4f2ae62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6896338-198e-4721-a4ab-f8a4d4f2ae62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d585a4f-433f-4ad0-bf06-ef049c81dea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d585a4f-433f-4ad0-bf06-ef049c81dea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b2ce56-43d4-4eed-af10-b30dee99e236', 'volume_name': 'volume-60b2ce56-43d4-4eed-af10-b30dee99e236', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170ab87a-ec5a-4716-804d-67409ce19f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170ab87a-ec5a-4716-804d-67409ce19f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace3805e-5e2a-4c14-8579-3779e5bccee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:49 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume 60b2ce56-43d4-4eed-af10-b30dee99e236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b2ce56-43d4-4eed-af10-b30dee99e236', 'volume_size': 1} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (145dc308-b69a-4331-b256-036f749c5ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6aa1150-eb72-438c-96f0-d53dc497be2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6aa1150-eb72-438c-96f0-d53dc497be2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-939427921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a28ad7a-6525-4433-ac89-0bc139251f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:50Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa40021-7dfa-4fb6-889b-4dcd7cf4050a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa40021-7dfa-4fb6-889b-4dcd7cf4050a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2567da73-dfa1-41c0-8bb8-d87f3cd6919b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2567da73-dfa1-41c0-8bb8-d87f3cd6919b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a28ad7a-6525-4433-ac89-0bc139251f4e', 'volume_name': 'volume-8a28ad7a-6525-4433-ac89-0bc139251f4e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:50 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cd16f4-dd5c-497d-99c3-cec9fb49fe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cd16f4-dd5c-497d-99c3-cec9fb49fe43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f598dae4-5a7a-4302-953a-550e5ccb059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:50 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume 8a28ad7a-6525-4433-ac89-0bc139251f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a28ad7a-6525-4433-ac89-0bc139251f4e', 'volume_size': 1} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862 1073741824" returned: 0 in 0.933s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:50 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862 Sep 07 02:25:50 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (1cc4c28f-7530-419b-af58-40a7dabf96c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91463d8c-c76c-4997-9f49-987ebf8162c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91463d8c-c76c-4997-9f49-987ebf8162c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733494626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ac20fe-04a3-4225-9253-19fb78f65b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:50Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9946121-9588-4800-b875-6156acdccd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:50 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9946121-9588-4800-b875-6156acdccd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57370f99-bd9d-4315-a964-e6f066b765b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57370f99-bd9d-4315-a964-e6f066b765b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ac20fe-04a3-4225-9253-19fb78f65b92', 'volume_name': 'volume-d4ac20fe-04a3-4225-9253-19fb78f65b92', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2a19a0-cc83-475b-be3b-8df3cfe04f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2a19a0-cc83-475b-be3b-8df3cfe04f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0504d9-42ac-46bd-a0db-8c6e8a96f60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:50 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume d4ac20fe-04a3-4225-9253-19fb78f65b92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ac20fe-04a3-4225-9253-19fb78f65b92', 'volume_size': 1} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862" returned: 0 in 0.461s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.086s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1760853844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b2ce56-43d4-4eed-af10-b30dee99e236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:49Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Creating volume 60b2ce56-43d4-4eed-af10-b30dee99e236 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:50 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd338ad-6b81-498a-a297-f3b4af56a101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306b913f-5c0e-4155-bedb-c222281bb862', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:50 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236 1073741824 Sep 07 02:25:50 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6face6f2-f724-4732-9a30-37f2afb032a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:50 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume volume-306b913f-5c0e-4155-bedb-c222281bb862 (306b913f-5c0e-4155-bedb-c222281bb862): created successfully Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6face6f2-f724-4732-9a30-37f2afb032a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (216b9e9b-7b22-4505-b0ec-d9e10230011e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8538fbed-f5e4-43e7-a5ae-154d0e345821 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created volume successfully. Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (2d777277-f877-4f19-a164-43c53bca7c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fc0e14-8922-4ef2-97f6-b6a714c5ed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fc0e14-8922-4ef2-97f6-b6a714c5ed21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1549253123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3516c4-0c7e-42fe-88de-c25845a9a72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:51Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd57e4a0-54eb-43fb-a814-80be7c47bb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd57e4a0-54eb-43fb-a814-80be7c47bb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bdcb1e6-7cc1-426f-9f70-ed5c98303f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bdcb1e6-7cc1-426f-9f70-ed5c98303f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3516c4-0c7e-42fe-88de-c25845a9a72f', 'volume_name': 'volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d419a6de-c6d9-4feb-82da-42da2e574592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d419a6de-c6d9-4feb-82da-42da2e574592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9af1f99-4508-4e31-a1f0-1f7a5942b1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume ed3516c4-0c7e-42fe-88de-c25845a9a72f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f', 'volume_size': 1} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:51 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Flow 'volume_create_manager' (a16bdcb3-bbec-4ba3-a063-3f565a9ee336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2fa455-4f37-4c73-99ca-558f9071a6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236 1073741824" returned: 0 in 0.829s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2fa455-4f37-4c73-99ca-558f9071a6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1640452901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167b14c3-d037-4613-8a21-b8cd3d5c5495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7a0019e378407690a9a8432c77d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:51Z,use_quota=True,user_id='85c5f051e2b04d18a472ed2f472e9f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5b7480-77b5-4dde-b612-87ada3bcbec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5b7480-77b5-4dde-b612-87ada3bcbec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9d075b-8ac5-4a72-852e-21f832c71303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9d075b-8ac5-4a72-852e-21f832c71303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '167b14c3-d037-4613-8a21-b8cd3d5c5495', 'volume_name': 'volume-167b14c3-d037-4613-8a21-b8cd3d5c5495', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38309304-5be7-463b-8338-ae13d11dcd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38309304-5be7-463b-8338-ae13d11dcd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a973d4-dcdd-4ec7-8e01-a8dcedaa0a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Volume 167b14c3-d037-4613-8a21-b8cd3d5c5495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-167b14c3-d037-4613-8a21-b8cd3d5c5495', 'volume_size': 1} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Flow 'volume_create_manager' (e9f1a3ac-db29-49ae-bfd9-48dd4d8c2045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75f1f31-867d-45c0-80d2-652738ae60bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75f1f31-867d-45c0-80d2-652738ae60bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-321622864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1290e38e-2daf-4ec4-87fe-1a7a4b85921e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b9fc35a72042f4ab6cc6549c6e7ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:51Z,use_quota=True,user_id='acf95621ba6f4b35ae9582fa8bf4ea3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236 Sep 07 02:25:51 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd023f5-a4fc-4f2f-9beb-0bce4e92b109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd023f5-a4fc-4f2f-9beb-0bce4e92b109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7b1448-7937-43e6-842d-e23e38f02e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7b1448-7937-43e6-842d-e23e38f02e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1290e38e-2daf-4ec4-87fe-1a7a4b85921e', 'volume_name': 'volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44791083-a297-4e69-8079-683286eec57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44791083-a297-4e69-8079-683286eec57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5c2839-74b8-4bfe-ab5f-5be2c40179ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:51 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Volume 1290e38e-2daf-4ec4-87fe-1a7a4b85921e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e', 'volume_size': 1} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:51 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236" returned: 0 in 0.324s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-939427921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a28ad7a-6525-4433-ac89-0bc139251f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:50Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Creating volume 8a28ad7a-6525-4433-ac89-0bc139251f4e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:51 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace3805e-5e2a-4c14-8579-3779e5bccee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b2ce56-43d4-4eed-af10-b30dee99e236', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:51 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e 1073741824 Sep 07 02:25:51 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9826549-2896-472f-a9df-7b87d3845801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:52 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume volume-60b2ce56-43d4-4eed-af10-b30dee99e236 (60b2ce56-43d4-4eed-af10-b30dee99e236): created successfully Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9826549-2896-472f-a9df-7b87d3845801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (d8862103-e3ea-4e39-9f8a-c92edaa532e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b5c1fb7c-9b0b-4d22-8747-2f872cbc2ed7 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created volume successfully. Sep 07 02:25:52 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e 1073741824" returned: 0 in 0.543s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:52 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e Sep 07 02:25:52 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:52 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e" returned: 0 in 0.289s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.232s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733494626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ac20fe-04a3-4225-9253-19fb78f65b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:50Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Creating volume d4ac20fe-04a3-4225-9253-19fb78f65b92 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:52 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f598dae4-5a7a-4302-953a-550e5ccb059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a28ad7a-6525-4433-ac89-0bc139251f4e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:52 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92 1073741824 Sep 07 02:25:52 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15e6e35-2b7d-4f8b-91db-ceab8f42b93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:52 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume volume-8a28ad7a-6525-4433-ac89-0bc139251f4e (8a28ad7a-6525-4433-ac89-0bc139251f4e): created successfully Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15e6e35-2b7d-4f8b-91db-ceab8f42b93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (145dc308-b69a-4331-b256-036f749c5ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-770c0f31-bcf0-4412-b902-59da477a33ac tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created volume successfully. Sep 07 02:25:53 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92 1073741824" returned: 0 in 0.593s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:53 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92 Sep 07 02:25:53 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:53 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92" returned: 0 in 0.370s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.550s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1549253123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3516c4-0c7e-42fe-88de-c25845a9a72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57748b36bf19479ab7aed0335364ffd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:51Z,use_quota=True,user_id='2edf1f67dcfc4145b216d563186e6d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Creating volume ed3516c4-0c7e-42fe-88de-c25845a9a72f {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:53 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0504d9-42ac-46bd-a0db-8c6e8a96f60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ac20fe-04a3-4225-9253-19fb78f65b92', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9fe5a0-30c2-479f-9ce5-90f986c52c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:53 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f 1073741824 Sep 07 02:25:53 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:53 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume volume-d4ac20fe-04a3-4225-9253-19fb78f65b92 (d4ac20fe-04a3-4225-9253-19fb78f65b92): created successfully Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9fe5a0-30c2-479f-9ce5-90f986c52c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (1cc4c28f-7530-419b-af58-40a7dabf96c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:53 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-bf1bf624-c3bf-4b78-abdb-b2bd61235c03 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created volume successfully. Sep 07 02:25:54 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f 1073741824" returned: 0 in 0.795s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:54 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f Sep 07 02:25:54 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:55 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f" returned: 0 in 0.282s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.472s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1640452901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167b14c3-d037-4613-8a21-b8cd3d5c5495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7a0019e378407690a9a8432c77d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:51Z,use_quota=True,user_id='85c5f051e2b04d18a472ed2f472e9f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Creating volume 167b14c3-d037-4613-8a21-b8cd3d5c5495 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:55 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9af1f99-4508-4e31-a1f0-1f7a5942b1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:55 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 1073741824 Sep 07 02:25:55 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcfe896-a7d7-48f9-a163-9af0c6681e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:55 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Volume volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f (ed3516c4-0c7e-42fe-88de-c25845a9a72f): created successfully Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcfe896-a7d7-48f9-a163-9af0c6681e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Flow 'volume_create_manager' (2d777277-f877-4f19-a164-43c53bca7c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:55 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ca6cd3bf-a66d-418e-88ef-92f8d17617c3 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created volume successfully. Sep 07 02:25:55 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 1073741824" returned: 0 in 0.553s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-ed3516c4-0c7e-42fe-88de-c25845a9a72f-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:55 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-ed3516c4-0c7e-42fe-88de-c25845a9a72f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:55 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-quobyte-ed3516c4-0c7e-42fe-88de-c25845a9a72f" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-ed3516c4-0c7e-42fe-88de-c25845a9a72f" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a9e24b-9b1d-403f-988b-573d65fc771d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:55 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f Sep 07 02:25:55 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:56 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495" returned: 0 in 0.523s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.483s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-321622864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1290e38e-2daf-4ec4-87fe-1a7a4b85921e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b9fc35a72042f4ab6cc6549c6e7ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:25:51Z,use_quota=True,user_id='acf95621ba6f4b35ae9582fa8bf4ea3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Creating volume 1290e38e-2daf-4ec4-87fe-1a7a4b85921e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:25:56 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:56 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e 1073741824 Sep 07 02:25:56 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a973d4-dcdd-4ec7-8e01-a8dcedaa0a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167b14c3-d037-4613-8a21-b8cd3d5c5495', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058057eb-3a11-47bd-991a-7b85cee1a8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:56 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Volume volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 (167b14c3-d037-4613-8a21-b8cd3d5c5495): created successfully Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058057eb-3a11-47bd-991a-7b85cee1a8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Flow 'volume_create_manager' (a16bdcb3-bbec-4ba3-a063-3f565a9ee336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:56 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c6c285bf-b3e6-492b-a590-6cea574e3020 tempest-TestStampPattern-1855254103 None] Created volume successfully. Sep 07 02:25:56 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f" returned: 0 in 0.499s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:56 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f Sep 07 02:25:56 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:56 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ed3516c4-0c7e-42fe-88de-c25845a9a72f" returned: 0 in 0.271s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-ed3516c4-0c7e-42fe-88de-c25845a9a72f" released by "delete_volume" :: held 0.830s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created reservations ['4c74c0d7-7475-4d04-96ba-d2048c9ee8b9', '21b22646-fc71-4c66-900e-94078f81a79b', '8d8d41f2-b120-458d-9ebc-b0bcaed64f96', '1dac6bc3-5256-4788-9357-9d89b94fc2e8'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:25:56 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e 1073741824" returned: 0 in 0.577s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:56 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:56 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:56 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e Sep 07 02:25:56 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-d4ac20fe-04a3-4225-9253-19fb78f65b92-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-d4ac20fe-04a3-4225-9253-19fb78f65b92-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-quobyte-d4ac20fe-04a3-4225-9253-19fb78f65b92" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-d4ac20fe-04a3-4225-9253-19fb78f65b92" acquired by "delete_volume" :: waited 0.035s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2a567c-e4d0-4e24-bdb0-3a540364e396]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:57 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e" returned: 0 in 0.360s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5c2839-74b8-4bfe-ab5f-5be2c40179ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26522c65-594b-4763-8195-47cd70ce97cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:25:57 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:57 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Volume volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e (1290e38e-2daf-4ec4-87fe-1a7a4b85921e): created successfully Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26522c65-594b-4763-8195-47cd70ce97cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Flow 'volume_create_manager' (e9f1a3ac-db29-49ae-bfd9-48dd4d8c2045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.522s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Deleted volume successfully. Sep 07 02:25:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-adb0f5d3-a181-4325-ada9-954dc869a031 tempest-AttachVolumeNegativeTest-1020865030 None] Created volume successfully. Sep 07 02:25:57 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92 Sep 07 02:25:57 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-737cc173-5367-407d-a444-66cdc9e381ed tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-ed3516c4-0c7e-42fe-88de-c25845a9a72f-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:57 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92" returned: 0 in 0.715s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:57 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92 Sep 07 02:25:57 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:58 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d4ac20fe-04a3-4225-9253-19fb78f65b92" returned: 0 in 0.685s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-d4ac20fe-04a3-4225-9253-19fb78f65b92" released by "delete_volume" :: held 1.536s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:58 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created reservations ['afd5e0e8-8818-4023-b190-eb66c18efe2b', 'cf581e08-a09e-47a4-9dff-f09078a3ae69', 'decea549-e303-4bf1-8d67-2532045b5996', '40272e1d-e19c-4868-872d-3aaa636a4ab5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:25:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:25:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:25:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:58 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:25:58 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:25:59 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.485s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:25:59 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Deleted volume successfully. Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-826f18d2-8026-43bb-bcca-546fa6f96a96 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-d4ac20fe-04a3-4225-9253-19fb78f65b92-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-8a28ad7a-6525-4433-ac89-0bc139251f4e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-45ad8a15-197c-4e50-9e81-e089351a3617 req-6819a051-8d14-4a9c-9fdd-461d25bc0ffd tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-45ad8a15-197c-4e50-9e81-e089351a3617 req-6819a051-8d14-4a9c-9fdd-461d25bc0ffd tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-8a28ad7a-6525-4433-ac89-0bc139251f4e-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-45ad8a15-197c-4e50-9e81-e089351a3617 req-6819a051-8d14-4a9c-9fdd-461d25bc0ffd tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-quobyte-8a28ad7a-6525-4433-ac89-0bc139251f4e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-45ad8a15-197c-4e50-9e81-e089351a3617 req-6819a051-8d14-4a9c-9fdd-461d25bc0ffd tempest-AttachVolumeNegativeTest-1020865030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd170faf1-0faa-40db-b89f-0a8a47c9f3e8', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-8a28ad7a-6525-4433-ac89-0bc139251f4e" acquired by "delete_volume" :: waited 0.035s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[28be17d0-803d-41e6-af6d-a443f652023a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:25:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:25:59 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-45ad8a15-197c-4e50-9e81-e089351a3617 req-6819a051-8d14-4a9c-9fdd-461d25bc0ffd tempest-AttachVolumeNegativeTest-1020865030 None] attachment_update completed successfully. Sep 07 02:25:59 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e Sep 07 02:25:59 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:00 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e" returned: 0 in 0.751s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:00 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e Sep 07 02:26:00 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:00 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a28ad7a-6525-4433-ac89-0bc139251f4e" returned: 0 in 0.515s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-8a28ad7a-6525-4433-ac89-0bc139251f4e" released by "delete_volume" :: held 1.361s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created reservations ['9a507a54-6435-4b66-9a2d-568066f6c6a5', '9cbbab2e-65e7-4ac0-8c61-31c785403daa', 'e67c09f5-e1cb-4be3-b744-6c35c9b60fe2', 'ccca95dd-117e-414d-af71-87718c25402d'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:01 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:26:01 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:01 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.545s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:26:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Deleted volume successfully. Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72921260-75f7-40d9-9df4-a7ae80bc3611 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-8a28ad7a-6525-4433-ac89-0bc139251f4e-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-60b2ce56-43d4-4eed-af10-b30dee99e236-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-60b2ce56-43d4-4eed-af10-b30dee99e236-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-quobyte-60b2ce56-43d4-4eed-af10-b30dee99e236" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-60b2ce56-43d4-4eed-af10-b30dee99e236" acquired by "delete_volume" :: waited 0.033s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:02 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc6e80c-3fbc-40e3-a9d1-308e391c354d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:02 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236 Sep 07 02:26:02 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-2e483ce2-fbd9-4cdc-aeb2-1113453b96ce req-b5778d9c-6954-4f76-b942-5cda1fe5fb83 tempest-AttachVolumeNegativeTest-1020865030 None] Terminate volume connection completed successfully. Sep 07 02:26:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-2e483ce2-fbd9-4cdc-aeb2-1113453b96ce req-b5778d9c-6954-4f76-b942-5cda1fe5fb83 tempest-AttachVolumeNegativeTest-1020865030 None] Deleting attachment d170faf1-0faa-40db-b89f-0a8a47c9f3e8. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:26:02 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236" returned: 0 in 0.749s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:02 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236 Sep 07 02:26:02 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:03 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-60b2ce56-43d4-4eed-af10-b30dee99e236" returned: 0 in 0.400s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-60b2ce56-43d4-4eed-af10-b30dee99e236" released by "delete_volume" :: held 1.237s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:03 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created reservations ['a20ba057-1933-45f2-9095-689138ba714b', '85c69491-b032-4447-bc32-2ef817c8f1a6', '0fba305b-1654-42d6-9f3a-636d4915b8c5', 'fc1fcbb8-5b6d-474f-bbb3-da18e048b450'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:26:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:03 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:26:03 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:03 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.437s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:03 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:26:04 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Deleted volume successfully. Sep 07 02:26:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eb5fa5ad-a035-4640-8d2b-1d3a062b3cdd tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-60b2ce56-43d4-4eed-af10-b30dee99e236-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-306b913f-5c0e-4155-bedb-c222281bb862-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-306b913f-5c0e-4155-bedb-c222281bb862-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-quobyte-306b913f-5c0e-4155-bedb-c222281bb862" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-306b913f-5c0e-4155-bedb-c222281bb862" acquired by "delete_volume" :: waited 0.033s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:04 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee67eb2-b43b-48bf-aa6c-7c813e5d2943]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:04 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862 Sep 07 02:26:04 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:05 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862" returned: 0 in 0.950s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:05 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862 Sep 07 02:26:05 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:06 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-306b913f-5c0e-4155-bedb-c222281bb862" returned: 0 in 0.444s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-306b913f-5c0e-4155-bedb-c222281bb862" released by "delete_volume" :: held 1.474s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created reservations ['23dd493c-e13d-40df-9d9c-c9c2886c3ac2', 'a89aa20f-027b-4d27-8d55-69cc980e99e9', '88f1b04c-9ad7-402e-8e9d-0271c94de364', '072f0dad-8581-4bd1-9417-faa4b7b3f35a'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:06 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:26:06 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:06 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.375s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:26:06 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Deleted volume successfully. Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8c4412f0-deff-4b67-9e03-9af66961db1e tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-306b913f-5c0e-4155-bedb-c222281bb862-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-f496a919-1b2b-42d6-ad86-604550b956fe-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-f496a919-1b2b-42d6-ad86-604550b956fe-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "cinder-quobyte-f496a919-1b2b-42d6-ad86-604550b956fe" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-f496a919-1b2b-42d6-ad86-604550b956fe" acquired by "delete_volume" :: waited 0.039s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2acc0ce-467a-47fe-b516-6be679192b2c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:07 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe Sep 07 02:26:07 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:26:07 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Flow 'volume_create_manager' (c9473d48-dc90-4ff3-9aa5-65e1aedac0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43e4388-9f4f-4131-bfe6-da096718e41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe" returned: 0 in 0.684s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:07 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe Sep 07 02:26:07 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43e4388-9f4f-4131-bfe6-da096718e41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba509870-94e4-4f27-a4cc-4a2af58ba280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6aecbbc93249b1aead37f7b87e45ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:08Z,use_quota=True,user_id='b9ebd94c61424f178e1d53eaa95108a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c46293-716d-4aee-ba6a-cf2765941983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c46293-716d-4aee-ba6a-cf2765941983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9b77cb-a90c-4b96-a000-67c39ee7c176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:07 devstack cinder-volume[87313]: DEBUG cinder.image.glance [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Creating Keystone auth plugin from conf {{(pid=87313) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 02:26:08 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f496a919-1b2b-42d6-ad86-604550b956fe" returned: 0 in 0.343s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-quobyte-f496a919-1b2b-42d6-ad86-604550b956fe" released by "delete_volume" :: held 1.106s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9b77cb-a90c-4b96-a000-67c39ee7c176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba509870-94e4-4f27-a4cc-4a2af58ba280', 'volume_name': 'volume-ba509870-94e4-4f27-a4cc-4a2af58ba280', 'volume_size': 1, 'image_id': '4d65f465-7df9-4006-9d7d-904742b554b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d65f465-7df9-4006-9d7d-904742b554b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99f6916d4e293fe3a2829f4aba50c085', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff6aecbbc93249b1aead37f7b87e45ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bae484512d800ae55be2540b6d2f4fef1f383a6c68feb6bc16d1f102cc3aebb8446270d0a2ec704269e231d63654281c6584cad309a34cd4f7cac1cddacde653', 'id': '4d65f465-7df9-4006-9d7d-904742b554b6', 'created_at': datetime.datetime(2026, 9, 7, 0, 26, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 26, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d65f465-7df9-4006-9d7d-904742b554b6/file', 'properties': {}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da943e32-70d4-4116-8029-acf394079a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da943e32-70d4-4116-8029-acf394079a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48080b59-a7e0-4e8c-b941-ccf7790c0c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:08 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Volume ba509870-94e4-4f27-a4cc-4a2af58ba280: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba509870-94e4-4f27-a4cc-4a2af58ba280', 'volume_size': 1, 'image_id': '4d65f465-7df9-4006-9d7d-904742b554b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d65f465-7df9-4006-9d7d-904742b554b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99f6916d4e293fe3a2829f4aba50c085', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff6aecbbc93249b1aead37f7b87e45ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bae484512d800ae55be2540b6d2f4fef1f383a6c68feb6bc16d1f102cc3aebb8446270d0a2ec704269e231d63654281c6584cad309a34cd4f7cac1cddacde653', 'id': '4d65f465-7df9-4006-9d7d-904742b554b6', 'created_at': datetime.datetime(2026, 9, 7, 0, 26, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 26, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d65f465-7df9-4006-9d7d-904742b554b6/file', 'properties': {}}, 'image_service': } Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Trying to clone ba509870-94e4-4f27-a4cc-4a2af58ba280 from image 4d65f465-7df9-4006-9d7d-904742b554b6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d65f465-7df9-4006-9d7d-904742b554b6', 'metadata': {}}]). {{(pid=87313) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Created reservations ['590c3a4a-04c5-46a6-ba96-1315e3230820', 'b0ee3898-c98c-4e5c-b072-6ea74e7f7f10', '240b5011-cb58-4d45-9d72-d0afdb55590a', '93f1c186-5f0a-4085-b922-de89566ee7ca'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 02:26:08 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Image download 0.00 MB at 0.00 MB/s Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:08 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:26:08 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b15e09-ff26-4d74-b7d0-053674ed6c52]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:08 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD Sep 07 02:26:08 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:08 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.325s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:26:08 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Deleted volume successfully. Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ae2b8276-937a-4f6c-87b1-9d1afcbc3c89 tempest-CreateVolumesFromSourceVolumeTest-1347461545 None] Lock "cinder-f496a919-1b2b-42d6-ad86-604550b956fe-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:08 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:08 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD Sep 07 02:26:08 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:09 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:26:09 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Temporary image 4d65f465-7df9-4006-9d7d-904742b554b6 is fetched for user b9ebd94c61424f178e1d53eaa95108a3. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 02:26:09 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e973f6-ada3-492e-a23e-b428918f5c29]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:09 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD Sep 07 02:26:09 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:09 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:09 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD Sep 07 02:26:09 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:10 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD" returned: 1 in 0.508s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba509870-94e4-4f27-a4cc-4a2af58ba280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6aecbbc93249b1aead37f7b87e45ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:08Z,use_quota=True,user_id='b9ebd94c61424f178e1d53eaa95108a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Creating volume ba509870-94e4-4f27-a4cc-4a2af58ba280 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:26:10 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:26:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:10 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 1073741824 Sep 07 02:26:10 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:11 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 1073741824" returned: 0 in 0.726s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:11 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 Sep 07 02:26:11 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:11 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280" returned: 0 in 0.299s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:26:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:11 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Attempting download of 4d65f465-7df9-4006-9d7d-904742b554b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d65f465-7df9-4006-9d7d-904742b554b6', 'metadata': {}}])) to volume ba509870-94e4-4f27-a4cc-4a2af58ba280. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 02:26:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d9b0f9-d79d-4f9b-8978-b8d1839a07a4]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d65f465-7df9-4006-9d7d-904742b554b6_89v6wi8g {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:11 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d65f465-7df9-4006-9d7d-904742b554b6_89v6wi8g Sep 07 02:26:11 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:11 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d65f465-7df9-4006-9d7d-904742b554b6_89v6wi8g" returned: 0 in 0.441s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d65f465-7df9-4006-9d7d-904742b554b6_89v6wi8g {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:12 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d65f465-7df9-4006-9d7d-904742b554b6_89v6wi8g Sep 07 02:26:12 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:12 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d65f465-7df9-4006-9d7d-904742b554b6_89v6wi8g" returned: 1 in 0.381s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d65f465-7df9-4006-9d7d-904742b554b6_89v6wi8g' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:26:12 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[360361f7-f8ea-4af6-8d65-20520f5572bf]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:12 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD Sep 07 02:26:12 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:12 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:12 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD Sep 07 02:26:12 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:13 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:26:13 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] 4d65f465-7df9-4006-9d7d-904742b554b6 was raw, converting to qcow2 {{(pid=87313) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 02:26:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:13 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 Sep 07 02:26:13 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:13 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280" returned: 0 in 0.563s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:13 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d65f465-7df9-4006-9d7d-904742b554b6_2tr8v769devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:26:13 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 02:26:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:13 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 1G Sep 07 02:26:13 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:14 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 1G" returned: 0 in 0.387s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:14 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Downloaded image 4d65f465-7df9-4006-9d7d-904742b554b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d65f465-7df9-4006-9d7d-904742b554b6', 'metadata': {}}])) to volume ba509870-94e4-4f27-a4cc-4a2af58ba280 successfully. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 02:26:14 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Temporary image 4d65f465-7df9-4006-9d7d-904742b554b6 for user b9ebd94c61424f178e1d53eaa95108a3 is deleted. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 02:26:14 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Marking volume ba509870-94e4-4f27-a4cc-4a2af58ba280 as bootable. {{(pid=87313) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 02:26:14 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Copying metadata from image 4d65f465-7df9-4006-9d7d-904742b554b6 to ba509870-94e4-4f27-a4cc-4a2af58ba280. {{(pid=87313) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 02:26:14 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Creating volume glance metadata for volume ba509870-94e4-4f27-a4cc-4a2af58ba280 backed by image 4d65f465-7df9-4006-9d7d-904742b554b6 with: {'image_id': '4d65f465-7df9-4006-9d7d-904742b554b6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '99f6916d4e293fe3a2829f4aba50c085', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87313) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 02:26:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48080b59-a7e0-4e8c-b941-ccf7790c0c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba509870-94e4-4f27-a4cc-4a2af58ba280', 'volume_size': 1, 'image_id': '4d65f465-7df9-4006-9d7d-904742b554b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d65f465-7df9-4006-9d7d-904742b554b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99f6916d4e293fe3a2829f4aba50c085', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff6aecbbc93249b1aead37f7b87e45ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bae484512d800ae55be2540b6d2f4fef1f383a6c68feb6bc16d1f102cc3aebb8446270d0a2ec704269e231d63654281c6584cad309a34cd4f7cac1cddacde653', 'id': '4d65f465-7df9-4006-9d7d-904742b554b6', 'created_at': datetime.datetime(2026, 9, 7, 0, 26, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 26, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d65f465-7df9-4006-9d7d-904742b554b6/file', 'properties': {}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3f91d3-9c90-48be-8c6d-9a5040bc24cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:14 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Volume volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 (ba509870-94e4-4f27-a4cc-4a2af58ba280): created successfully Sep 07 02:26:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3f91d3-9c90-48be-8c6d-9a5040bc24cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Flow 'volume_create_manager' (c9473d48-dc90-4ff3-9aa5-65e1aedac0e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:14 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e1fe1226-08fc-4642-9a34-b718ed4c8bc6 tempest-VolumeImageDependencyTests-149059006 None] Created volume successfully. Sep 07 02:26:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Acquiring lock "cinder-ba509870-94e4-4f27-a4cc-4a2af58ba280-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Lock "cinder-ba509870-94e4-4f27-a4cc-4a2af58ba280-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Acquiring lock "cinder-quobyte-ba509870-94e4-4f27-a4cc-4a2af58ba280" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Lock "cinder-quobyte-ba509870-94e4-4f27-a4cc-4a2af58ba280" acquired by "delete_volume" :: waited 0.033s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:15 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0ca0f9-7491-43de-92d6-f8fd0fa26119]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:15 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 Sep 07 02:26:15 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:16 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280" returned: 0 in 0.595s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:16 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280 Sep 07 02:26:16 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:16 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ba509870-94e4-4f27-a4cc-4a2af58ba280" returned: 0 in 0.282s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Lock "cinder-quobyte-ba509870-94e4-4f27-a4cc-4a2af58ba280" released by "delete_volume" :: held 0.960s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Created reservations ['3502a623-3c94-43e1-878c-d6b2192a265f', 'ddbd634e-f06c-46f8-9b7b-42e1dbccbeaf', 'd63148a9-a66f-4d6c-b6c3-e696cc1ff9a5', '0b302d02-a38f-4a8e-ba5a-fb1fe80642a8'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:16 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:26:16 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:16 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.284s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:26:16 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Deleted volume successfully. Sep 07 02:26:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9c64ad92-1fd8-4f78-ad28-531eb65e1cf3 tempest-VolumeImageDependencyTests-149059006 None] Lock "cinder-ba509870-94e4-4f27-a4cc-4a2af58ba280-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-51417595-5d91-443e-9720-5c4414154680 req-a1cff1ff-55e9-4139-9e8c-6fef3ff3cf3f tempest-TestStampPattern-1855254103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-51417595-5d91-443e-9720-5c4414154680 req-a1cff1ff-55e9-4139-9e8c-6fef3ff3cf3f tempest-TestStampPattern-1855254103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-51417595-5d91-443e-9720-5c4414154680 req-a1cff1ff-55e9-4139-9e8c-6fef3ff3cf3f tempest-TestStampPattern-1855254103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-51417595-5d91-443e-9720-5c4414154680 req-a1cff1ff-55e9-4139-9e8c-6fef3ff3cf3f tempest-TestStampPattern-1855254103 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-167b14c3-d037-4613-8a21-b8cd3d5c5495', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7353d165-f2ce-4740-a4e5-59420b705ccb', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:26 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-51417595-5d91-443e-9720-5c4414154680 req-a1cff1ff-55e9-4139-9e8c-6fef3ff3cf3f tempest-TestStampPattern-1855254103 None] attachment_update completed successfully. Sep 07 02:26:26 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:26:26 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:26 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.407s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:26:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Flow 'volume_create_manager' (f2ffab29-61cd-4e43-b3c0-74ea04645780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec44f74-6795-479e-b075-ce32673b584a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec44f74-6795-479e-b075-ce32673b584a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193992927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4f63e4-7de2-4796-8f3e-711200b89295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d28b7c2bf74704a8131aecc8230db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:31Z,use_quota=True,user_id='7d309687f6c9463b81ae2e9309d0dbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33a0295-6986-4b28-86d8-3a00d48552ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33a0295-6986-4b28-86d8-3a00d48552ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b68792c-19e0-46a6-8e46-bc0918cb467f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b68792c-19e0-46a6-8e46-bc0918cb467f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a4f63e4-7de2-4796-8f3e-711200b89295', 'volume_name': 'volume-8a4f63e4-7de2-4796-8f3e-711200b89295', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da841fd-cee2-48fe-93ae-7f7ef3fcf7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da841fd-cee2-48fe-93ae-7f7ef3fcf7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810215d8-f447-44b2-b9c9-dff425c0fa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:30 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Volume 8a4f63e4-7de2-4796-8f3e-711200b89295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a4f63e4-7de2-4796-8f3e-711200b89295', 'volume_size': 1} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193992927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4f63e4-7de2-4796-8f3e-711200b89295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d28b7c2bf74704a8131aecc8230db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:31Z,use_quota=True,user_id='7d309687f6c9463b81ae2e9309d0dbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Creating volume 8a4f63e4-7de2-4796-8f3e-711200b89295 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:26:30 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:26:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:30 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295 1073741824 Sep 07 02:26:30 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:31 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295 1073741824" returned: 0 in 0.496s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:31 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295 Sep 07 02:26:31 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:31 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295" returned: 0 in 0.290s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:26:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810215d8-f447-44b2-b9c9-dff425c0fa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a4f63e4-7de2-4796-8f3e-711200b89295', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730335fe-da1d-4172-a913-a9031cdfc2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:31 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Volume volume-8a4f63e4-7de2-4796-8f3e-711200b89295 (8a4f63e4-7de2-4796-8f3e-711200b89295): created successfully Sep 07 02:26:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730335fe-da1d-4172-a913-a9031cdfc2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Flow 'volume_create_manager' (f2ffab29-61cd-4e43-b3c0-74ea04645780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-92ab8e99-d3f4-4f61-9117-a118b4cace9d req-14269a9f-8319-4a68-919a-19c6b9b04b4b tempest-TestStampPattern-1855254103 None] Terminate volume connection completed successfully. Sep 07 02:26:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-92ab8e99-d3f4-4f61-9117-a118b4cace9d req-14269a9f-8319-4a68-919a-19c6b9b04b4b tempest-TestStampPattern-1855254103 None] Deleting attachment 7353d165-f2ce-4740-a4e5-59420b705ccb. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:26:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6e62c144-6510-4137-b5dd-f11d8bafeeff tempest-ProjectReaderTests-1337026139 None] Created volume successfully. Sep 07 02:26:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] Creating offline snapshot 59865c2f-0f8b-46c4-9064-558a5e490c44 of volume 167b14c3-d037-4613-8a21-b8cd3d5c5495 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:26:32 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45b8cb0-28eb-4e7d-a302-51703ddc40af]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:32 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 Sep 07 02:26:32 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Acquiring lock "cinder-8a4f63e4-7de2-4796-8f3e-711200b89295-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Lock "cinder-8a4f63e4-7de2-4796-8f3e-711200b89295-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:33 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495" returned: 0 in 0.397s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:33 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 1G Sep 07 02:26:33 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Acquiring lock "cinder-quobyte-8a4f63e4-7de2-4796-8f3e-711200b89295" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Lock "cinder-quobyte-8a4f63e4-7de2-4796-8f3e-711200b89295" acquired by "delete_volume" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f9b427-d552-4db5-879e-da76b3e3d6de]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:33 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295 Sep 07 02:26:33 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:33 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 1G" returned: 0 in 0.470s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:33 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 Sep 07 02:26:33 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:33 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295" returned: 0 in 0.437s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:33 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295 Sep 07 02:26:33 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:33 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44" returned: 0 in 0.325s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:33 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 is being set with open permissions: ugo+rw Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:33 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8a4f63e4-7de2-4796-8f3e-711200b89295" returned: 0 in 0.283s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:33 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 Sep 07 02:26:33 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Lock "cinder-quobyte-8a4f63e4-7de2-4796-8f3e-711200b89295" released by "delete_volume" :: held 0.770s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:DELETE=12,cinder:UPDATE=151,cinder:SELECT=107,cinder:INSERT=29 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=113,cinder:INSERT=42,cinder:UPDATE=129,cinder:DELETE=12 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Created reservations ['e8ce0527-cb85-4791-b33b-8a8602b7af24', '33d197c7-396e-49ce-936a-25bc03180fad', 'c921e56b-c664-4833-9a79-abe472af1bc5', '7ae068e4-12ee-46da-add4-4ae023ad274d'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:34 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:26:34 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:34 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44" returned: 0 in 0.263s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:34 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.info Sep 07 02:26:34 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:34 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.263s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:26:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Deleted volume successfully. Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04038821-c8ab-47c6-b80f-d789133f21cc tempest-ProjectReaderTests-1337026139 None] Lock "cinder-8a4f63e4-7de2-4796-8f3e-711200b89295-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:34 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.info" returned: 0 in 0.300s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:34 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.info is being set with open permissions: ugo+rw Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:34 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.info Sep 07 02:26:34 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Flow 'volume_create_manager' (44195a77-f793-4510-86b0-ed128a10ba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c82836b-472e-4476-bbb6-027aa0f45088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c82836b-472e-4476-bbb6-027aa0f45088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593559480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f63af7f-e331-4dc2-83dc-e627c7041a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d28b7c2bf74704a8131aecc8230db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:35Z,use_quota=True,user_id='7d309687f6c9463b81ae2e9309d0dbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcccaa6d-be7c-43d7-897a-0400eac1b174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcccaa6d-be7c-43d7-897a-0400eac1b174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:34 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9c8e42-018a-4f33-abc6-d3e5a5a33667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9c8e42-018a-4f33-abc6-d3e5a5a33667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f63af7f-e331-4dc2-83dc-e627c7041a49', 'volume_name': 'volume-1f63af7f-e331-4dc2-83dc-e627c7041a49', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0e9f9e-1457-482f-af36-6f20ac14912c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0e9f9e-1457-482f-af36-6f20ac14912c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743a1feb-8824-4068-a26b-1c53c848f9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:34 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Volume 1f63af7f-e331-4dc2-83dc-e627c7041a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f63af7f-e331-4dc2-83dc-e627c7041a49', 'volume_size': 1} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.info" returned: 0 in 0.291s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593559480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f63af7f-e331-4dc2-83dc-e627c7041a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d28b7c2bf74704a8131aecc8230db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:35Z,use_quota=True,user_id='7d309687f6c9463b81ae2e9309d0dbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Creating volume 1f63af7f-e331-4dc2-83dc-e627c7041a49 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:26:34 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:26:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:34 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49 1073741824 Sep 07 02:26:34 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-47c846e2-e266-40d7-8944-9b44c9bbbbb1 tempest-TestStampPattern-1855254103 None] Create snapshot completed successfully Sep 07 02:26:35 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49 1073741824" returned: 0 in 0.402s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:35 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49 Sep 07 02:26:35 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:35 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49" returned: 0 in 0.256s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743a1feb-8824-4068-a26b-1c53c848f9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f63af7f-e331-4dc2-83dc-e627c7041a49', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a52aea-f030-4b33-bf06-6568f61f8458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:35 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Volume volume-1f63af7f-e331-4dc2-83dc-e627c7041a49 (1f63af7f-e331-4dc2-83dc-e627c7041a49): created successfully Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a52aea-f030-4b33-bf06-6568f61f8458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Flow 'volume_create_manager' (44195a77-f793-4510-86b0-ed128a10ba2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:35 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-84ac3da3-8123-4a06-9841-634819a6d948 tempest-ProjectReaderTests-1337026139 None] Created volume successfully. Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "cinder-1f63af7f-e331-4dc2-83dc-e627c7041a49-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-1f63af7f-e331-4dc2-83dc-e627c7041a49-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "cinder-quobyte-1f63af7f-e331-4dc2-83dc-e627c7041a49" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-quobyte-1f63af7f-e331-4dc2-83dc-e627c7041a49" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[67518489-bc61-4a6e-a6a8-4b2d915d2328]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:35 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49 Sep 07 02:26:35 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:36 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49" returned: 0 in 0.362s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:36 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49 Sep 07 02:26:36 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:36 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1f63af7f-e331-4dc2-83dc-e627c7041a49" returned: 0 in 0.262s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-quobyte-1f63af7f-e331-4dc2-83dc-e627c7041a49" released by "delete_volume" :: held 0.669s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Created reservations ['31c51d75-df8c-4cfd-8c5a-c0f62231badd', 'd7eca5f2-81b6-43c4-b01a-5513ea62fee6', '8000c72c-e856-4089-9093-1ffe9c5f1bca', '492bd8e5-3e21-4e0d-87fb-52cf69dda0c5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:36 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:26:36 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:36 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.285s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:26:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Deleted volume successfully. Sep 07 02:26:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75cc478c-d2fe-4fed-8c2f-46858605ca39 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-1f63af7f-e331-4dc2-83dc-e627c7041a49-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Flow 'volume_create_manager' (a35b7bde-634d-4f22-92ff-d53e698283a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2b1b9d-44ae-4829-a40d-ebe124186b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2b1b9d-44ae-4829-a40d-ebe124186b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302868578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c8c376-9389-40ca-807d-44219109c235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d28b7c2bf74704a8131aecc8230db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:37Z,use_quota=True,user_id='7d309687f6c9463b81ae2e9309d0dbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6e8255-ab41-40ba-9e7c-ee9bebdfe663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6e8255-ab41-40ba-9e7c-ee9bebdfe663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51950c4d-8713-4234-8892-30f3b28820e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51950c4d-8713-4234-8892-30f3b28820e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c8c376-9389-40ca-807d-44219109c235', 'volume_name': 'volume-79c8c376-9389-40ca-807d-44219109c235', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6dcd23-2e14-42f3-8bf7-d0cc36bb7dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6dcd23-2e14-42f3-8bf7-d0cc36bb7dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089017ae-a3b5-425f-a97f-d406e445c4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:37 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Volume 79c8c376-9389-40ca-807d-44219109c235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c8c376-9389-40ca-807d-44219109c235', 'volume_size': 1} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302868578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c8c376-9389-40ca-807d-44219109c235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d28b7c2bf74704a8131aecc8230db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:37Z,use_quota=True,user_id='7d309687f6c9463b81ae2e9309d0dbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Creating volume 79c8c376-9389-40ca-807d-44219109c235 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:26:37 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:37 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235 1073741824 Sep 07 02:26:37 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:37 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235 1073741824" returned: 0 in 0.478s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:37 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235 Sep 07 02:26:37 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:38 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235" returned: 0 in 0.252s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089017ae-a3b5-425f-a97f-d406e445c4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c8c376-9389-40ca-807d-44219109c235', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae9fed5-ff2e-4955-8a07-0bc6597dee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:38 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Volume volume-79c8c376-9389-40ca-807d-44219109c235 (79c8c376-9389-40ca-807d-44219109c235): created successfully Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae9fed5-ff2e-4955-8a07-0bc6597dee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Flow 'volume_create_manager' (a35b7bde-634d-4f22-92ff-d53e698283a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0f7aebb4-3888-443c-b310-12d376e30d28 tempest-ProjectReaderTests-1337026139 None] Created volume successfully. Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "cinder-79c8c376-9389-40ca-807d-44219109c235-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-79c8c376-9389-40ca-807d-44219109c235-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "cinder-quobyte-79c8c376-9389-40ca-807d-44219109c235" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-quobyte-79c8c376-9389-40ca-807d-44219109c235" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[077ee1b5-7136-472c-be50-c03abc2b25eb]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:38 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235 Sep 07 02:26:38 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:38 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235" returned: 0 in 0.380s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:38 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235 Sep 07 02:26:38 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:39 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-79c8c376-9389-40ca-807d-44219109c235" returned: 0 in 0.275s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-quobyte-79c8c376-9389-40ca-807d-44219109c235" released by "delete_volume" :: held 0.705s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Created reservations ['15efdeb1-694e-4f63-a31a-f595bfc98c23', 'fa058d82-11e7-4f19-a060-c97f4e9ecd5a', '9d2fdcaa-c2db-439e-a2cc-abcf77320ffa', '03978eb8-4515-4ddd-9390-f10847c17e8f'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:39 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:26:39 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:39 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.265s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:26:39 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Deleted volume successfully. Sep 07 02:26:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-674aec09-b852-48ec-b501-62fa214148d4 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-79c8c376-9389-40ca-807d-44219109c235-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Flow 'volume_create_manager' (22993565-5175-4888-a915-fdf88e1b912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdaf2b1-5e46-4251-acf1-9e9e23788b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdaf2b1-5e46-4251-acf1-9e9e23788b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667926776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8b424d-a090-4909-b019-22eab64c4cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d28b7c2bf74704a8131aecc8230db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:40Z,use_quota=True,user_id='7d309687f6c9463b81ae2e9309d0dbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba79c6c-6bdd-41df-a390-7b7bfa5ebfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba79c6c-6bdd-41df-a390-7b7bfa5ebfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdbaba6-c62d-4be6-a8be-06269b6263cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdbaba6-c62d-4be6-a8be-06269b6263cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8b424d-a090-4909-b019-22eab64c4cf2', 'volume_name': 'volume-da8b424d-a090-4909-b019-22eab64c4cf2', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453e66a8-b0c8-44ca-99aa-bc6e75194f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453e66a8-b0c8-44ca-99aa-bc6e75194f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fbe597-000d-4bda-aea2-a2e6179100cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:40 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Volume da8b424d-a090-4909-b019-22eab64c4cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8b424d-a090-4909-b019-22eab64c4cf2', 'volume_size': 1} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667926776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8b424d-a090-4909-b019-22eab64c4cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d28b7c2bf74704a8131aecc8230db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:40Z,use_quota=True,user_id='7d309687f6c9463b81ae2e9309d0dbd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Creating volume da8b424d-a090-4909-b019-22eab64c4cf2 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:26:40 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:40 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2 1073741824 Sep 07 02:26:40 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:40 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2 1073741824" returned: 0 in 0.472s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:40 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2 Sep 07 02:26:40 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:41 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2" returned: 0 in 0.324s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:26:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fbe597-000d-4bda-aea2-a2e6179100cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8b424d-a090-4909-b019-22eab64c4cf2', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebdd7372-02a9-4ea6-a689-75fabd3676cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:41 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Volume volume-da8b424d-a090-4909-b019-22eab64c4cf2 (da8b424d-a090-4909-b019-22eab64c4cf2): created successfully Sep 07 02:26:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebdd7372-02a9-4ea6-a689-75fabd3676cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:41 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Flow 'volume_create_manager' (22993565-5175-4888-a915-fdf88e1b912b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:41 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-af8566d7-a665-4fc2-b9ea-03d8e8b1bf40 tempest-ProjectReaderTests-1337026139 None] Created volume successfully. Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "cinder-da8b424d-a090-4909-b019-22eab64c4cf2-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-da8b424d-a090-4909-b019-22eab64c4cf2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "cinder-quobyte-da8b424d-a090-4909-b019-22eab64c4cf2" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-quobyte-da8b424d-a090-4909-b019-22eab64c4cf2" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[9439459e-da51-4cb4-961b-1ec1ce50917b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:42 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2 Sep 07 02:26:42 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Flow 'volume_create_manager' (ea241dd9-4754-42fb-9779-9874a077ab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03367f43-bfe7-4459-beb2-9612b3ddc54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03367f43-bfe7-4459-beb2-9612b3ddc54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1825342645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7a0019e378407690a9a8432c77d296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59865c2f-0f8b-46c4-9064-558a5e490c44,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:42Z,use_quota=True,user_id='85c5f051e2b04d18a472ed2f472e9f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa9cea7-820b-4817-af54-2d3c1b9d3924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa9cea7-820b-4817-af54-2d3c1b9d3924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99673b4-47db-46cb-923d-9c26f608e621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99673b4-47db-46cb-923d-9c26f608e621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c', 'volume_name': 'volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c', 'volume_size': 1, 'snapshot_id': '59865c2f-0f8b-46c4-9064-558a5e490c44'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecff005-cf18-4dc9-b302-3cb9b4b2d65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecff005-cf18-4dc9-b302-3cb9b4b2d65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bd7034-81d0-41fb-8ff8-3547892bdb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:42 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Volume a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c', 'volume_size': 1, 'snapshot_id': '59865c2f-0f8b-46c4-9064-558a5e490c44'} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Acquiring lock "cinder-quobyte-59865c2f-0f8b-46c4-9064-558a5e490c44-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" by "_create_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-59865c2f-0f8b-46c4-9064-558a5e490c44-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Creating volume a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c from snapshot 59865c2f-0f8b-46c4-9064-558a5e490c44 {{(pid=87313) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Acquiring lock "cinder-quobyte-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] snapshot: 59865c2f-0f8b-46c4-9064-558a5e490c44, volume: a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[232bdd54-9d9c-4a70-9f45-bc48ebb7e44c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:42 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2" returned: 0 in 0.430s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:42 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2 Sep 07 02:26:42 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:42 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 Sep 07 02:26:42 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:43 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-da8b424d-a090-4909-b019-22eab64c4cf2" returned: 0 in 0.265s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-quobyte-da8b424d-a090-4909-b019-22eab64c4cf2" released by "delete_volume" :: held 0.754s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Created reservations ['f5e659ba-a540-4f65-9fa4-8ca995b4dd49', '3684f503-4123-4f84-a686-767bcc329dcc', 'b45b29fe-dd62-4393-92d1-f1f38dea122b', '23f9ccb9-50b8-4cb4-96db-1f3b5c064ce6'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:26:43 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44" returned: 0 in 0.412s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-167b14c3-d037-4613-8a21-b8cd3d5c5495(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[92590a9a-d91a-4e8e-a523-9c6072ba4649]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:43 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:26:43 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:43 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 Sep 07 02:26:43 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:43 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.396s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:26:43 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Deleted volume successfully. Sep 07 02:26:43 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495" returned: 0 in 0.494s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c32f8dab-1b27-4dea-9b02-796d91cc5e73 tempest-ProjectReaderTests-1337026139 None] Lock "cinder-da8b424d-a090-4909-b019-22eab64c4cf2-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:43 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c Sep 07 02:26:43 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Flow 'volume_create_manager' (8f95c7e3-42e5-439c-bdde-67800847e16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac5eee7-6b57-4c35-ac3c-6dd6e8a23ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac5eee7-6b57-4c35-ac3c-6dd6e8a23ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1104360770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b048dfbf-f6c0-4129-9ce5-82b7a5b01b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b9fc35a72042f4ab6cc6549c6e7ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:44Z,use_quota=True,user_id='acf95621ba6f4b35ae9582fa8bf4ea3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9f3dc7-184c-46f1-98b8-673bc7693890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9f3dc7-184c-46f1-98b8-673bc7693890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d0f793-3c12-43b2-b7eb-16144d3aabf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d0f793-3c12-43b2-b7eb-16144d3aabf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b048dfbf-f6c0-4129-9ce5-82b7a5b01b36', 'volume_name': 'volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c282799-7d2c-4885-8323-2832f17ee610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c282799-7d2c-4885-8323-2832f17ee610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c389692c-308e-4fb9-94b0-bcc3b418b5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:44 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Volume b048dfbf-f6c0-4129-9ce5-82b7a5b01b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36', 'volume_size': 1} Sep 07 02:26:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:50 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" returned: 0 in 6.948s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:50 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495, size 1024.00 MB, duration 6.95 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:26:50 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Converted 1024.00 MB image at 147.33 MB/s Sep 07 02:26:50 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c is being set with open permissions: ugo+rw Sep 07 02:26:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:50 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c Sep 07 02:26:50 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:50 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" returned: 0 in 0.364s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" released by "_copy_volume_from_snapshot" :: held 8.338s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-59865c2f-0f8b-46c4-9064-558a5e490c44-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" released by "_create_volume_from_snapshot" :: held 8.431s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.448s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.656s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1104360770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b048dfbf-f6c0-4129-9ce5-82b7a5b01b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b9fc35a72042f4ab6cc6549c6e7ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:26:44Z,use_quota=True,user_id='acf95621ba6f4b35ae9582fa8bf4ea3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Creating volume b048dfbf-f6c0-4129-9ce5-82b7a5b01b36 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:26:51 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bd7034-81d0-41fb-8ff8-3547892bdb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c', 'volume_size': 1, 'snapshot_id': '59865c2f-0f8b-46c4-9064-558a5e490c44'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0b7214-cf1e-4881-aa67-e64a18e3290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:51 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36 1073741824 Sep 07 02:26:51 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:51 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Volume volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c (a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c): created successfully Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0b7214-cf1e-4881-aa67-e64a18e3290f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Flow 'volume_create_manager' (ea241dd9-4754-42fb-9779-9874a077ab5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:51 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c65274c2-b8b7-4896-a243-e2740875d804 tempest-TestStampPattern-1855254103 None] Created volume successfully. Sep 07 02:26:51 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36 1073741824" returned: 0 in 0.687s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:26:51 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36 Sep 07 02:26:51 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:26:52 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Sep 07 02:26:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36" returned: 0 in 0.311s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:26:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:26:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c389692c-308e-4fb9-94b0-bcc3b418b5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c235d79c-4b7e-440a-8845-a5bf3d77b286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:26:52 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Volume volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36 (b048dfbf-f6c0-4129-9ce5-82b7a5b01b36): created successfully Sep 07 02:26:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c235d79c-4b7e-440a-8845-a5bf3d77b286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:26:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Flow 'volume_create_manager' (8f95c7e3-42e5-439c-bdde-67800847e16f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:26:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-097b1356-8d63-4490-9ba7-5e3d81a14e83 tempest-AttachVolumeNegativeTest-1020865030 None] Created volume successfully. Sep 07 02:26:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-8c5b08fb-6b1c-44d3-ac77-bc5a9551239a req-c7b1e4c8-84a2-4c54-8052-b54202efd99d tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:26:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-8c5b08fb-6b1c-44d3-ac77-bc5a9551239a req-c7b1e4c8-84a2-4c54-8052-b54202efd99d tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:26:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-8c5b08fb-6b1c-44d3-ac77-bc5a9551239a req-c7b1e4c8-84a2-4c54-8052-b54202efd99d tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:26:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-8c5b08fb-6b1c-44d3-ac77-bc5a9551239a req-c7b1e4c8-84a2-4c54-8052-b54202efd99d tempest-AttachVolumeNegativeTest-1020865030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '909277df-8294-4cbe-9f9d-ac51bc1adafa', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:26:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-8c5b08fb-6b1c-44d3-ac77-bc5a9551239a req-c7b1e4c8-84a2-4c54-8052-b54202efd99d tempest-AttachVolumeNegativeTest-1020865030 None] attachment_update completed successfully. Sep 07 02:26:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-442456aa-6109-4610-a135-3b56803bd638 req-c8d8e4a5-ae2b-4271-9520-8607abbc1d1e tempest-AttachVolumeNegativeTest-1020865030 None] Terminate volume connection completed successfully. Sep 07 02:26:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-442456aa-6109-4610-a135-3b56803bd638 req-c8d8e4a5-ae2b-4271-9520-8607abbc1d1e tempest-AttachVolumeNegativeTest-1020865030 None] Deleting attachment 909277df-8294-4cbe-9f9d-ac51bc1adafa. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:27:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "cinder-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "cinder-quobyte-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-quobyte-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f313c8de-958d-453e-a49e-f4341dd40a1e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:04 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36 Sep 07 02:27:04 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:04 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36" returned: 0 in 0.391s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:04 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36 Sep 07 02:27:04 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:04 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36" returned: 0 in 0.302s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-quobyte-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36" released by "delete_volume" :: held 0.747s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Created reservations ['b2554f8b-7c25-412e-8952-7e691890c504', 'a58e818b-520c-411d-8a6a-12c59ab9a501', 'ae892f3f-e5a2-45b2-a399-3dd17f8b5c77', 'bd3cfca8-5b5a-436b-be3f-3b50cd576d4b'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:04 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:27:04 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:05 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.320s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:05 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:27:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Deleted volume successfully. Sep 07 02:27:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-217a0b62-5130-45be-bd55-9ae1e4aa1912 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-b048dfbf-f6c0-4129-9ce5-82b7a5b01b36-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "cinder-1290e38e-2daf-4ec4-87fe-1a7a4b85921e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-1290e38e-2daf-4ec4-87fe-1a7a4b85921e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "cinder-quobyte-1290e38e-2daf-4ec4-87fe-1a7a4b85921e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-quobyte-1290e38e-2daf-4ec4-87fe-1a7a4b85921e" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:05 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a549e1-142a-4177-a616-1739cbb8f3d2]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:05 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e Sep 07 02:27:05 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:05 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e" returned: 0 in 0.416s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:05 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e Sep 07 02:27:05 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:06 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1290e38e-2daf-4ec4-87fe-1a7a4b85921e" returned: 0 in 0.277s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-quobyte-1290e38e-2daf-4ec4-87fe-1a7a4b85921e" released by "delete_volume" :: held 0.745s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Created reservations ['953f9ef5-c91a-4a1b-a986-73143f2721f9', '15ae1b44-e6ac-4f0c-b1b9-3ccbc56d5ed8', '61e01d3d-4e1c-47be-b5da-20454c521511', '8b0462ca-d3b0-4685-8c54-496fd4e8ce6f'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:06 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:27:06 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:06 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.341s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:27:06 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Deleted volume successfully. Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2cb5bbe0-4000-49c6-a9ea-2e2d9ae02de0 tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-1290e38e-2daf-4ec4-87fe-1a7a4b85921e-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "cinder-3150da7b-6e05-467f-a491-bb1dfff4a9a1-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-3150da7b-6e05-467f-a491-bb1dfff4a9a1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "cinder-quobyte-3150da7b-6e05-467f-a491-bb1dfff4a9a1" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-quobyte-3150da7b-6e05-467f-a491-bb1dfff4a9a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8e4860-50cc-498b-9b5a-7b12f952504d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:07 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1 Sep 07 02:27:07 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:07 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1" returned: 0 in 0.403s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:07 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1 Sep 07 02:27:07 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:07 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3150da7b-6e05-467f-a491-bb1dfff4a9a1" returned: 0 in 0.288s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-quobyte-3150da7b-6e05-467f-a491-bb1dfff4a9a1" released by "delete_volume" :: held 0.738s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Created reservations ['5e9763c9-887c-4956-990a-78d404f7cb87', '33677aca-5648-44d7-b82d-fc947ac8c7e0', '32c899f2-41d5-4a4b-a303-c65f714d7ef1', 'f12dfd1b-b0e4-4eb0-b9ca-c13f2e93f154'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:07 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:27:07 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:08 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.332s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:08 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:27:08 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Deleted volume successfully. Sep 07 02:27:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-708ba2bf-0078-4efd-bdd6-bcb5b79869ed tempest-AttachVolumeNegativeTest-1020865030 None] Lock "cinder-3150da7b-6e05-467f-a491-bb1dfff4a9a1-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Flow 'volume_create_manager' (904075a4-8764-4a22-b6d0-ef6308792d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfd9b5c-6db6-4364-8a27-79a5cf48341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfd9b5c-6db6-4364-8a27-79a5cf48341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-865067825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d629c9de-13ec-455a-9f7b-5004f17763c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90b97cb3ae74df58ec70d706864b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:27:14Z,use_quota=True,user_id='6416c5810269428695723ec91c8a1fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36099251-bb02-4491-a880-1f0a4bd99256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36099251-bb02-4491-a880-1f0a4bd99256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70342862-ea60-420b-b4fc-116867065478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70342862-ea60-420b-b4fc-116867065478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd629c9de-13ec-455a-9f7b-5004f17763c5', 'volume_name': 'volume-d629c9de-13ec-455a-9f7b-5004f17763c5', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad06c1f-56d0-4088-8ce6-9dfb355d114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad06c1f-56d0-4088-8ce6-9dfb355d114e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d46e75-d8d0-47b3-9da9-8eda2fd25333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:14 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Volume d629c9de-13ec-455a-9f7b-5004f17763c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d629c9de-13ec-455a-9f7b-5004f17763c5', 'volume_size': 1} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-865067825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d629c9de-13ec-455a-9f7b-5004f17763c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90b97cb3ae74df58ec70d706864b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:27:14Z,use_quota=True,user_id='6416c5810269428695723ec91c8a1fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Creating volume d629c9de-13ec-455a-9f7b-5004f17763c5 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:27:14 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:14 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 1073741824 Sep 07 02:27:14 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:14 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 1073741824" returned: 0 in 0.454s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:14 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 Sep 07 02:27:14 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:15 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5" returned: 0 in 0.278s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:27:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d46e75-d8d0-47b3-9da9-8eda2fd25333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d629c9de-13ec-455a-9f7b-5004f17763c5', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335cf25d-16c4-4abb-91f7-e96561e62d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:15 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Volume volume-d629c9de-13ec-455a-9f7b-5004f17763c5 (d629c9de-13ec-455a-9f7b-5004f17763c5): created successfully Sep 07 02:27:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335cf25d-16c4-4abb-91f7-e96561e62d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Flow 'volume_create_manager' (904075a4-8764-4a22-b6d0-ef6308792d68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:15 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8e6563f1-56c8-4551-87f0-5dd3e8e1dd2a tempest-SnapshotDependencyTests-568682652 None] Created volume successfully. Sep 07 02:27:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] Creating offline snapshot 3909a896-b37c-4412-aa2c-852f89772bce of volume d629c9de-13ec-455a-9f7b-5004f17763c5 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:27:16 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f24d679-542c-42b3-bb5e-1269befad2a5]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:16 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 Sep 07 02:27:16 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:16 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5" returned: 0 in 0.376s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:16 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce 1G Sep 07 02:27:16 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:17 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce 1G" returned: 0 in 0.451s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d629c9de-13ec-455a-9f7b-5004f17763c5 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:17 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d629c9de-13ec-455a-9f7b-5004f17763c5 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce Sep 07 02:27:17 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:17 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d629c9de-13ec-455a-9f7b-5004f17763c5 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce" returned: 0 in 0.391s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:17 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce is being set with open permissions: ugo+rw Sep 07 02:27:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:17 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce Sep 07 02:27:17 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:18 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce" returned: 0 in 0.271s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:18 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.info Sep 07 02:27:18 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:18 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.info" returned: 0 in 0.321s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:18 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.info is being set with open permissions: ugo+rw Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:18 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.info Sep 07 02:27:18 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Flow 'volume_create_manager' (d31263fb-f94a-4961-8339-9684e958b5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f40818-9657-46a1-80db-79faee9e139f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f40818-9657-46a1-80db-79faee9e139f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2140317751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c9c864-fb57-49fd-aea4-e5b1c4dbc97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef13b1c9bd9422597443e74a278525c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:27:19Z,use_quota=True,user_id='db94d8a169ae42e9be65c9efa94ae459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae41f12-a63a-4d81-ae41-03a693e2d1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae41f12-a63a-4d81-ae41-03a693e2d1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7742a9-e80f-4e86-a974-f12b70cc11ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7742a9-e80f-4e86-a974-f12b70cc11ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c9c864-fb57-49fd-aea4-e5b1c4dbc97c', 'volume_name': 'volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e464850e-cc32-43fa-8d4b-08e09b6424ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e464850e-cc32-43fa-8d4b-08e09b6424ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf82667-5d19-462b-a34e-cef8bcb85cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:18 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Volume 62c9c864-fb57-49fd-aea4-e5b1c4dbc97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c', 'volume_size': 1} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:18 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.info" returned: 0 in 0.287s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2140317751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c9c864-fb57-49fd-aea4-e5b1c4dbc97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef13b1c9bd9422597443e74a278525c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:27:19Z,use_quota=True,user_id='db94d8a169ae42e9be65c9efa94ae459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Creating volume 62c9c864-fb57-49fd-aea4-e5b1c4dbc97c {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:27:18 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:27:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:18 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c 1073741824 Sep 07 02:27:18 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-41169a23-590d-4fef-8f8e-fbc6dfa220ac tempest-SnapshotDependencyTests-568682652 None] Create snapshot completed successfully Sep 07 02:27:18 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:19 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c 1073741824" returned: 0 in 0.404s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:19 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c Sep 07 02:27:19 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:19 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf82667-5d19-462b-a34e-cef8bcb85cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7625033e-ef24-4cb2-bbc0-f2ecbfe2118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:19 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Volume volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c (62c9c864-fb57-49fd-aea4-e5b1c4dbc97c): created successfully Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7625033e-ef24-4cb2-bbc0-f2ecbfe2118f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Flow 'volume_create_manager' (d31263fb-f94a-4961-8339-9684e958b5ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:19 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-cd200881-0be3-40b1-9788-968a06431bd1 req-7186abac-1bb2-4c93-93de-de9366def734 tempest-VolumesSnapshotsTestJSON-528785062 None] Created volume successfully. Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] Creating offline snapshot b04b404c-e031-4934-9e1b-56799bcd29c6 of volume 62c9c864-fb57-49fd-aea4-e5b1c4dbc97c {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[da10f2f9-83fe-4354-9612-287f9e6eea1a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:20 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c Sep 07 02:27:20 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:20 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c" returned: 0 in 0.401s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:20 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 1G Sep 07 02:27:20 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Flow 'volume_create_manager' (8a853550-4d60-4aa6-a339-8d567ac6fb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b84643-035e-46c5-8e8f-ba4a954f54e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b84643-035e-46c5-8e8f-ba4a954f54e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee1b816-8cde-4624-8f28-243d7870a11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90b97cb3ae74df58ec70d706864b8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3909a896-b37c-4412-aa2c-852f89772bce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:27:20Z,use_quota=True,user_id='6416c5810269428695723ec91c8a1fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ad25fa-907b-45b4-afe0-ddb6128f0386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ad25fa-907b-45b4-afe0-ddb6128f0386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6934f95-1545-4898-b6ab-0481d3aacf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6934f95-1545-4898-b6ab-0481d3aacf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8ee1b816-8cde-4624-8f28-243d7870a11f', 'volume_name': 'volume-8ee1b816-8cde-4624-8f28-243d7870a11f', 'volume_size': 1, 'snapshot_id': '3909a896-b37c-4412-aa2c-852f89772bce'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bb5935-301f-4413-ba4e-56633273b65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bb5935-301f-4413-ba4e-56633273b65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f3ce16-eb6e-406d-9d7c-d4c4641d3325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:20 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Volume 8ee1b816-8cde-4624-8f28-243d7870a11f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8ee1b816-8cde-4624-8f28-243d7870a11f', 'volume_size': 1, 'snapshot_id': '3909a896-b37c-4412-aa2c-852f89772bce'} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:20 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 1G" returned: 0 in 0.449s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:20 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 Sep 07 02:27:20 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:21 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6" returned: 0 in 0.319s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:21 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 is being set with open permissions: ugo+rw Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:21 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 Sep 07 02:27:21 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-30f37a98-9b0a-407b-aab2-829a7e641312 req-949549d7-4a7e-4e79-b210-22f500faff91 tempest-TestStampPattern-1855254103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:21 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6" returned: 0 in 0.255s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:21 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.info Sep 07 02:27:21 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:21 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.info" returned: 0 in 0.248s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:21 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.info is being set with open permissions: ugo+rw Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:21 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.info Sep 07 02:27:21 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:21 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.info" returned: 0 in 0.244s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.395s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "cinder-quobyte-3909a896-b37c-4412-aa2c-852f89772bce-8ee1b816-8cde-4624-8f28-243d7870a11f" by "_create_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-3909a896-b37c-4412-aa2c-852f89772bce-8ee1b816-8cde-4624-8f28-243d7870a11f" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Creating volume 8ee1b816-8cde-4624-8f28-243d7870a11f from snapshot 3909a896-b37c-4412-aa2c-852f89772bce {{(pid=87313) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "cinder-quobyte-8ee1b816-8cde-4624-8f28-243d7870a11f" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:21 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-8da2ae21-10f4-4199-9c00-229731654e1f req-db3d8700-6262-430a-89f0-102dbbb268a3 tempest-VolumesSnapshotsTestJSON-528785062 None] Create snapshot completed successfully Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-8ee1b816-8cde-4624-8f28-243d7870a11f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] snapshot: 3909a896-b37c-4412-aa2c-852f89772bce, volume: 8ee1b816-8cde-4624-8f28-243d7870a11f, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b3009e-c8a0-44b8-8bf6-22d1f153347d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:22 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce Sep 07 02:27:22 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Acquiring lock "cinder-b04b404c-e031-4934-9e1b-56799bcd29c6-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "cinder-b04b404c-e031-4934-9e1b-56799bcd29c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Acquiring lock "cinder-quobyte-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "cinder-quobyte-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Acquiring lock "cinder-quobyte-b04b404c-e031-4934-9e1b-56799bcd29c6" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "cinder-quobyte-b04b404c-e031-4934-9e1b-56799bcd29c6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Deleting offline snapshot b04b404c-e031-4934-9e1b-56799bcd29c6 of volume 62c9c864-fb57-49fd-aea4-e5b1c4dbc97c {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] snapshot_file for this snap is: volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[471cd5b8-47e7-4b0b-9309-2ac61722863c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:22 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce" returned: 0 in 0.381s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d629c9de-13ec-455a-9f7b-5004f17763c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2f0236-bda3-43a7-b168-a834eee5e82f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:22 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 Sep 07 02:27:22 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:22 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 Sep 07 02:27:22 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:22 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6" returned: 0 in 0.362s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[7600b6a4-c14b-4cc5-836b-ff63cc1dfcfc]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:22 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5" returned: 0 in 0.359s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:27:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:22 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f Sep 07 02:27:22 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:22 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c Sep 07 02:27:22 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:23 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c" returned: 0 in 0.379s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:23 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 Sep 07 02:27:23 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:23 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6" returned: 0 in 0.745s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:23 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6 Sep 07 02:27:23 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:24 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c.b04b404c-e031-4934-9e1b-56799bcd29c6" returned: 0 in 0.414s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "cinder-quobyte-b04b404c-e031-4934-9e1b-56799bcd29c6" released by "_delete_snapshot" :: held 2.082s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "cinder-quobyte-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c" released by "delete_snapshot" :: held 2.122s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:24 devstack cinder-volume[87313]: DEBUG cinder.quota [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Created reservations ['ed70ae11-3ae7-42c2-9572-0e2a5cbc5c00', 'd80e1934-50a2-437a-a734-70abc8d2bcf2', '3788a0aa-e577-4f83-8098-2ed1b5d34e1b', 'f6dee2db-79db-420a-98d3-7e11ab357534'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:24 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Delete snapshot completed successfully. Sep 07 02:27:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-6ffb97ae-7840-4060-9270-038fd9c5b9c2 req-007e0acd-77fe-4567-b19d-1fef2ff9d04f tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "cinder-b04b404c-e031-4934-9e1b-56799bcd29c6-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Acquiring lock "cinder-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "cinder-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Acquiring lock "cinder-quobyte-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "cinder-quobyte-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cec1de-0845-4f05-9e75-3732eeca45d7]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:26 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:26 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:26 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:27:26 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:26 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c" returned: 0 in 0.665s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:26 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.541s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:27:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:27:26 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c Sep 07 02:27:26 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:27 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c" returned: 0 in 0.466s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "cinder-quobyte-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c" released by "delete_volume" :: held 1.293s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG cinder.quota [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Created reservations ['3008cbba-5cd9-4a44-8333-7e2b7203370e', 'dc378fc5-03d9-4991-a717-52e2a646e6ef', '41ec85da-545c-47ec-af91-b16eeb1fcf13', 'db7f10df-62f8-472a-97d5-9a4504ee380c'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:27 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:27:27 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:27 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f" returned: 0 in 5.147s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:27:27 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Converted 1024.00 MB image at 198.89 MB/s Sep 07 02:27:27 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f is being set with open permissions: ugo+rw Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:27 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.364s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG cinder.manager [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:27:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Deleted volume successfully. Sep 07 02:27:27 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f Sep 07 02:27:27 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [req-92ff3fd6-8a47-4cb0-8e29-3956708f8da4 req-9f7564ba-f2a2-4766-b865-45227a345d50 tempest-VolumesSnapshotsTestJSON-528785062 None] Lock "cinder-62c9c864-fb57-49fd-aea4-e5b1c4dbc97c-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:28 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f" returned: 0 in 0.256s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-8ee1b816-8cde-4624-8f28-243d7870a11f" released by "_copy_volume_from_snapshot" :: held 6.224s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-3909a896-b37c-4412-aa2c-852f89772bce-8ee1b816-8cde-4624-8f28-243d7870a11f" released by "_create_volume_from_snapshot" :: held 6.291s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.316s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-30f37a98-9b0a-407b-aab2-829a7e641312 req-949549d7-4a7e-4e79-b210-22f500faff91 tempest-TestStampPattern-1855254103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.964s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-30f37a98-9b0a-407b-aab2-829a7e641312 req-949549d7-4a7e-4e79-b210-22f500faff91 tempest-TestStampPattern-1855254103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f3ce16-eb6e-406d-9d7c-d4c4641d3325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee1b816-8cde-4624-8f28-243d7870a11f', 'volume_size': 1, 'snapshot_id': '3909a896-b37c-4412-aa2c-852f89772bce'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9e16c4-6a89-4857-885f-b3663679e650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:28 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Volume volume-8ee1b816-8cde-4624-8f28-243d7870a11f (8ee1b816-8cde-4624-8f28-243d7870a11f): created successfully Sep 07 02:27:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9e16c4-6a89-4857-885f-b3663679e650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Flow 'volume_create_manager' (8a853550-4d60-4aa6-a339-8d567ac6fb74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-30f37a98-9b0a-407b-aab2-829a7e641312 req-949549d7-4a7e-4e79-b210-22f500faff91 tempest-TestStampPattern-1855254103 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4beb659-fdc0-4801-a39c-518dfab7c6a4', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:27:28 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f63e5da0-3253-429c-91fb-a68054412ce1 tempest-SnapshotDependencyTests-568682652 None] Created volume successfully. Sep 07 02:27:28 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-30f37a98-9b0a-407b-aab2-829a7e641312 req-949549d7-4a7e-4e79-b210-22f500faff91 tempest-TestStampPattern-1855254103 None] attachment_update completed successfully. Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "cinder-3909a896-b37c-4412-aa2c-852f89772bce-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-3909a896-b37c-4412-aa2c-852f89772bce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "cinder-quobyte-d629c9de-13ec-455a-9f7b-5004f17763c5" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-d629c9de-13ec-455a-9f7b-5004f17763c5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "cinder-quobyte-3909a896-b37c-4412-aa2c-852f89772bce" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-3909a896-b37c-4412-aa2c-852f89772bce" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Deleting offline snapshot 3909a896-b37c-4412-aa2c-852f89772bce of volume d629c9de-13ec-455a-9f7b-5004f17763c5 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] snapshot_file for this snap is: volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[7357454c-2737-4f95-a194-bccb5c9fb409]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:29 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce Sep 07 02:27:29 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:29 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce" returned: 0 in 0.389s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d629c9de-13ec-455a-9f7b-5004f17763c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[5394fa20-1884-4fbd-bc5e-0931af0c26a5]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:29 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 Sep 07 02:27:29 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:30 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5" returned: 0 in 0.612s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:30 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce Sep 07 02:27:30 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:30 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce" returned: 0 in 0.381s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:30 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce Sep 07 02:27:30 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:30 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5.3909a896-b37c-4412-aa2c-852f89772bce" returned: 0 in 0.266s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-3909a896-b37c-4412-aa2c-852f89772bce" released by "_delete_snapshot" :: held 1.775s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-d629c9de-13ec-455a-9f7b-5004f17763c5" released by "delete_snapshot" :: held 1.800s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Created reservations ['746785fa-87a4-45ed-b3e8-47601fc4754e', '88021925-7af2-45c3-9829-e38d0348216d', '907c9f53-00c5-43ab-8dfa-9f2f5ca73d2c', '55691820-7c33-4a77-a87e-8bc653c71ef2'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Delete snapshot completed successfully. Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c8cdabd0-c724-4b56-93e0-b07265e4a861 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-3909a896-b37c-4412-aa2c-852f89772bce-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "cinder-d629c9de-13ec-455a-9f7b-5004f17763c5-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-d629c9de-13ec-455a-9f7b-5004f17763c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "cinder-quobyte-d629c9de-13ec-455a-9f7b-5004f17763c5" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-d629c9de-13ec-455a-9f7b-5004f17763c5" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[120285a2-3053-46c2-bbc6-75095e246872]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:31 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 Sep 07 02:27:31 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-4c091397-bcc2-41d8-849d-c2ad97284e00 req-8ded5dea-9203-4401-a34e-ab617b2fbf91 tempest-TestStampPattern-1855254103 None] Terminate volume connection completed successfully. Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-4c091397-bcc2-41d8-849d-c2ad97284e00 req-8ded5dea-9203-4401-a34e-ab617b2fbf91 tempest-TestStampPattern-1855254103 None] Deleting attachment b4beb659-fdc0-4801-a39c-518dfab7c6a4. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:27:31 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5" returned: 0 in 0.428s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:31 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5 Sep 07 02:27:31 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:32 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d629c9de-13ec-455a-9f7b-5004f17763c5" returned: 0 in 0.252s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-d629c9de-13ec-455a-9f7b-5004f17763c5" released by "delete_volume" :: held 0.738s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Created reservations ['9a9f127c-3394-4a11-aab1-dba3d393cb85', 'c7818197-de47-42ba-a209-a7639272efb2', 'b3a5d782-bb92-4392-a12d-58701fcf412b', 'b2a0b7a0-36a2-48c1-89f2-56ab3ed41680'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:32 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:27:32 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "cinder-8ee1b816-8cde-4624-8f28-243d7870a11f-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-8ee1b816-8cde-4624-8f28-243d7870a11f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:32 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.320s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:27:32 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Deleted volume successfully. Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "cinder-quobyte-8ee1b816-8cde-4624-8f28-243d7870a11f" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-99a1f4f5-b265-41f4-a115-8caeaf24d6d2 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-d629c9de-13ec-455a-9f7b-5004f17763c5-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-8ee1b816-8cde-4624-8f28-243d7870a11f" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a49ec1a-db4f-4fc3-bed8-3fc8c3148c4b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:32 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f Sep 07 02:27:32 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:33 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f" returned: 0 in 0.467s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:33 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a48e23bf-94b3-4be6-a430-0317ef36be53 tempest-GroupSnapshotsTest-996806646 None] Group tempest-GroupSnapshotsTest-Group-357020599: creating Sep 07 02:27:33 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f Sep 07 02:27:33 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:33 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a48e23bf-94b3-4be6-a430-0317ef36be53 tempest-GroupSnapshotsTest-996806646 None] Group tempest-GroupSnapshotsTest-Group-357020599: created successfully Sep 07 02:27:33 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a48e23bf-94b3-4be6-a430-0317ef36be53 tempest-GroupSnapshotsTest-996806646 None] Create group completed successfully. Sep 07 02:27:33 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8ee1b816-8cde-4624-8f28-243d7870a11f" returned: 0 in 0.355s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-quobyte-8ee1b816-8cde-4624-8f28-243d7870a11f" released by "delete_volume" :: held 0.871s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:33 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Created reservations ['5d91c2f8-85a0-4291-a6a2-1290fa2f0b17', 'd946604f-406a-4216-b2df-a3600632246f', 'e077cf00-9158-4357-846c-d94d812002c4', '34fafa16-f93e-4d4f-88fd-582efd9b6aec'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:33 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:27:33 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:34 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.441s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:34 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:27:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Deleted volume successfully. Sep 07 02:27:34 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:INSERT=26,cinder:UPDATE=127,cinder:SELECT=103,cinder:DELETE=12 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:27:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5c259c8e-c728-422c-bc69-8054b98e9900 tempest-SnapshotDependencyTests-568682652 None] Lock "cinder-8ee1b816-8cde-4624-8f28-243d7870a11f-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:34 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=106,cinder:INSERT=33,cinder:UPDATE=118,cinder:DELETE=9 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:27:34 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Flow 'volume_create_manager' (e4f1be4c-fa4a-4b8f-a1f7-7fb0df8cccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1241eb23-8a76-4107-8319-105995747145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1241eb23-8a76-4107-8319-105995747145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-527694057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb0998aa-0776-42df-9080-05fdb87492d9,host='devstack@QuobyteHD#QuobyteHD',id=8d4d7a96-ba0a-414d-8686-206fa0f5e3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e0820c0783416c83cfcb3dd756ce61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:27:35Z,use_quota=True,user_id='4652edcee26d409197a81fc0e3efa8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a382b1d-7ec8-4e59-b052-1d6c05587e61),volume_type_id=4a382b1d-7ec8-4e59-b052-1d6c05587e61)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df742e05-551e-4405-8ceb-1bc3868a8289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df742e05-551e-4405-8ceb-1bc3868a8289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13085558-58d1-4921-91e1-899b41255c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13085558-58d1-4921-91e1-899b41255c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4d7a96-ba0a-414d-8686-206fa0f5e3df', 'volume_name': 'volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e39d794-7a12-4c8d-a932-2f3c984fa185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e39d794-7a12-4c8d-a932-2f3c984fa185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4551a445-87d5-4750-b6ff-b7ac80272934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:35 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Volume 8d4d7a96-ba0a-414d-8686-206fa0f5e3df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df', 'volume_size': 1} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb0998aa-0776-42df-9080-05fdb87492d9,created_at=2026-09-07T00:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-527694057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb0998aa-0776-42df-9080-05fdb87492d9,host='devstack@QuobyteHD#QuobyteHD',id=8d4d7a96-ba0a-414d-8686-206fa0f5e3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e0820c0783416c83cfcb3dd756ce61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:27:35Z,use_quota=True,user_id='4652edcee26d409197a81fc0e3efa8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a382b1d-7ec8-4e59-b052-1d6c05587e61),volume_type_id=4a382b1d-7ec8-4e59-b052-1d6c05587e61)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Creating volume 8d4d7a96-ba0a-414d-8686-206fa0f5e3df {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:27:35 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:35 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df 1073741824 Sep 07 02:27:35 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:35 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df 1073741824" returned: 0 in 0.543s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:35 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df Sep 07 02:27:35 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:35 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" returned: 0 in 0.266s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4551a445-87d5-4750-b6ff-b7ac80272934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13171616-31fa-449d-9c0d-dc1faa0c64e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:35 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Volume volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df (8d4d7a96-ba0a-414d-8686-206fa0f5e3df): created successfully Sep 07 02:27:35 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13171616-31fa-449d-9c0d-dc1faa0c64e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Flow 'volume_create_manager' (e4f1be4c-fa4a-4b8f-a1f7-7fb0df8cccfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0fd0544b-32fa-4236-b15e-05cbeece6c42 tempest-GroupSnapshotsTest-996806646 None] Created volume successfully. Sep 07 02:27:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] GroupSnapshot 30184bd4-2622-4abd-bb9b-0fbf1b1688de: creating. Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] Group snapshot 30184bd4-2622-4abd-bb9b-0fbf1b1688de: creating. {{(pid=87313) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] Creating offline snapshot 9ed31750-9714-4c78-ae50-ed4b961dfcc3 of volume 8d4d7a96-ba0a-414d-8686-206fa0f5e3df {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be34544-af39-4004-ac52-d9acaf3a6a80]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:36 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df Sep 07 02:27:36 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Acquiring lock "cinder-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Lock "cinder-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Acquiring lock "cinder-quobyte-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" acquired by "delete_volume" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab8a31-c81f-4fd5-88d2-53efbdc8015d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:36 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" returned: 0 in 0.409s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:36 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 1G Sep 07 02:27:36 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:36 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c Sep 07 02:27:36 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:37 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" returned: 0 in 0.406s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:37 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c Sep 07 02:27:37 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:37 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 1G" returned: 0 in 0.476s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:37 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 Sep 07 02:27:37 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:37 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" returned: 0 in 0.284s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c" released by "delete_volume" :: held 0.746s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Created reservations ['4b3d23b0-fcaa-4582-936a-b2c2b26d8341', '24ebb65a-c647-4fcb-9622-107b4529bd65', 'beaa05a1-0af0-42cd-ac9c-73cfd7e2a1d5', '4bff509c-4b5b-4e75-a07e-dcc9171e3886'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:37 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3" returned: 0 in 0.305s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:37 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:37 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 Sep 07 02:27:37 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:37 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:27:37 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:37 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:37 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3" returned: 0 in 0.275s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.258s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:27:37 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Deleted volume successfully. Sep 07 02:27:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c02abb0b-941b-4ae2-875f-dec93f5470ee tempest-TestStampPattern-1855254103 None] Lock "cinder-a8c9dec0-f4aa-4b54-b509-b1a4f7f1260c-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:38 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.info Sep 07 02:27:38 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Acquiring lock "cinder-59865c2f-0f8b-46c4-9064-558a5e490c44-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Lock "cinder-59865c2f-0f8b-46c4-9064-558a5e490c44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Acquiring lock "cinder-quobyte-167b14c3-d037-4613-8a21-b8cd3d5c5495" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-167b14c3-d037-4613-8a21-b8cd3d5c5495" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Acquiring lock "cinder-quobyte-59865c2f-0f8b-46c4-9064-558a5e490c44" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-59865c2f-0f8b-46c4-9064-558a5e490c44" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Deleting offline snapshot 59865c2f-0f8b-46c4-9064-558a5e490c44 of volume 167b14c3-d037-4613-8a21-b8cd3d5c5495 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:27:38 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] snapshot_file for this snap is: volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.info" returned: 0 in 0.340s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:38 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1911ca-c5df-4b82-9e5e-ceafef2b9b15]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:38 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.info Sep 07 02:27:38 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:38 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 Sep 07 02:27:38 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:38 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.info" returned: 0 in 0.333s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a11e43a2-df9f-4351-a325-88db135f990d tempest-GroupSnapshotsTest-996806646 None] group_snapshot 30184bd4-2622-4abd-bb9b-0fbf1b1688de: created successfully Sep 07 02:27:38 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44" returned: 0 in 0.457s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-167b14c3-d037-4613-8a21-b8cd3d5c5495(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8083ef-c4dd-4bbf-a49c-54d3ec7900b6]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:38 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 Sep 07 02:27:38 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:39 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495" returned: 0 in 0.548s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:39 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 Sep 07 02:27:39 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:39 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44" returned: 0 in 0.376s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:39 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44 Sep 07 02:27:39 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:40 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495.59865c2f-0f8b-46c4-9064-558a5e490c44" returned: 0 in 0.267s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-59865c2f-0f8b-46c4-9064-558a5e490c44" released by "_delete_snapshot" :: held 1.793s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-167b14c3-d037-4613-8a21-b8cd3d5c5495" released by "delete_snapshot" :: held 1.825s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Created reservations ['969dc48a-1adf-4d48-a0f1-ba300a501803', 'f658cc8f-5446-48cb-b532-d84120cf5a11', 'a0a19c08-e5de-4fd2-b81f-c18b4f9f7985', 'd9beb113-62d4-490d-876c-c071e9f042cd'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Delete snapshot completed successfully. Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-12ad7236-febb-4e92-be1b-162c4ace258f tempest-TestStampPattern-1855254103 None] Lock "cinder-59865c2f-0f8b-46c4-9064-558a5e490c44-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-9ed31750-9714-4c78-ae50-ed4b961dfcc3-a4af82b5-b945-45f3-8688-6c26558df7c1" by "_create_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-9ed31750-9714-4c78-ae50-ed4b961dfcc3-a4af82b5-b945-45f3-8688-6c26558df7c1" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Creating volume a4af82b5-b945-45f3-8688-6c26558df7c1 from snapshot 9ed31750-9714-4c78-ae50-ed4b961dfcc3 {{(pid=87313) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-a4af82b5-b945-45f3-8688-6c26558df7c1" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-a4af82b5-b945-45f3-8688-6c26558df7c1" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] snapshot: 9ed31750-9714-4c78-ae50-ed4b961dfcc3, volume: a4af82b5-b945-45f3-8688-6c26558df7c1, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e49072-d226-4d45-ad9d-264465f55d7e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:40 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 Sep 07 02:27:40 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:40 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3" returned: 0 in 0.449s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[15342159-c54f-4966-aa1e-97f9658e50df]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:41 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df Sep 07 02:27:41 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:41 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" returned: 0 in 0.492s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:27:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:27:41 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1 not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:27:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:41 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1 Sep 07 02:27:41 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Acquiring lock "cinder-167b14c3-d037-4613-8a21-b8cd3d5c5495-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Lock "cinder-167b14c3-d037-4613-8a21-b8cd3d5c5495-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:46 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Acquiring lock "cinder-quobyte-167b14c3-d037-4613-8a21-b8cd3d5c5495" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:46 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-167b14c3-d037-4613-8a21-b8cd3d5c5495" acquired by "delete_volume" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:46 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ba3031-848b-436a-9883-12c4167ea678]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:46 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 Sep 07 02:27:46 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:47 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1" returned: 0 in 5.824s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:27:47 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Converted 1024.00 MB image at 175.79 MB/s Sep 07 02:27:47 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:27:47 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495" returned: 0 in 1.060s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:47 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1 Sep 07 02:27:47 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:47 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495 Sep 07 02:27:47 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:47 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1" returned: 0 in 0.293s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-a4af82b5-b945-45f3-8688-6c26558df7c1" released by "_copy_volume_from_snapshot" :: held 7.152s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:47 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-167b14c3-d037-4613-8a21-b8cd3d5c5495" returned: 0 in 0.301s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Lock "cinder-quobyte-167b14c3-d037-4613-8a21-b8cd3d5c5495" released by "delete_volume" :: held 1.518s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-9ed31750-9714-4c78-ae50-ed4b961dfcc3-a4af82b5-b945-45f3-8688-6c26558df7c1" released by "_create_volume_from_snapshot" :: held 7.302s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.326s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Created reservations ['ba4c2b6e-09fe-489f-af96-f014a0d58752', 'd9cec1aa-b738-4296-a9e6-5316704f1529', 'c558d20b-dc7d-4c0e-8469-a21f5ed996c3', '6f41078d-7dac-448e-a6ee-768a297707fa'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:47 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c6286644-2c33-4235-b165-33ccb9e7d7f9 tempest-GroupSnapshotsTest-996806646 None] Create group from source-snapshot-30184bd4-2622-4abd-bb9b-0fbf1b1688de completed successfully. Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:47 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:27:47 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:48 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.292s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:48 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:27:48 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Deleted volume successfully. Sep 07 02:27:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ce241ba9-a4e1-4680-b526-514da2d8f1ab tempest-TestStampPattern-1855254103 None] Lock "cinder-167b14c3-d037-4613-8a21-b8cd3d5c5495-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-a4af82b5-b945-45f3-8688-6c26558df7c1" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-a4af82b5-b945-45f3-8688-6c26558df7c1" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[767190ce-e5a8-4bb5-9c90-925409b8f823]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:49 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1 Sep 07 02:27:49 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:49 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1" returned: 0 in 0.418s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:49 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1 Sep 07 02:27:49 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:50 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a4af82b5-b945-45f3-8688-6c26558df7c1" returned: 0 in 0.286s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-a4af82b5-b945-45f3-8688-6c26558df7c1" released by "delete_volume" :: held 0.759s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Created reservations ['2558a8b0-65dd-4dcb-9e8a-1ccf4fd79b64'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:50 devstack cinder-volume[87313]: WARNING cinder.quota [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2058317914 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2058317914, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:27:50 devstack cinder-volume[87313]: WARNING cinder.quota [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2058317914 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2058317914, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Created reservations ['1c019ec9-9b25-4437-bfa9-5eeb79c413f7', '5678edfb-a6a9-40fe-9a7e-74a10871b8ee', 'a43da22a-ba15-47c1-afd5-3ac3510c2b1e', '41802905-549c-4ee7-982c-2626e013bc1f'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:50 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:27:50 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:50 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.294s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:27:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] group_snapshot 30184bd4-2622-4abd-bb9b-0fbf1b1688de: deleting Sep 07 02:27:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b40a18b6-2c2c-4852-a523-45246bf01919 tempest-GroupSnapshotsTest-996806646 None] Delete group completed successfully. Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] group_snapshot 30184bd4-2622-4abd-bb9b-0fbf1b1688de: deleting {{(pid=87313) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-9ed31750-9714-4c78-ae50-ed4b961dfcc3" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-9ed31750-9714-4c78-ae50-ed4b961dfcc3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Deleting offline snapshot 9ed31750-9714-4c78-ae50-ed4b961dfcc3 of volume 8d4d7a96-ba0a-414d-8686-206fa0f5e3df {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] snapshot_file for this snap is: volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f772798-9619-46b5-9e06-ce900933c4bb]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:50 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 Sep 07 02:27:50 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:51 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3" returned: 0 in 0.388s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:27:51 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[29edaeac-5948-4998-b9dd-2ac9bb948851]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:51 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df Sep 07 02:27:51 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:51 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" returned: 0 in 0.583s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:51 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 Sep 07 02:27:51 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:52 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3" returned: 0 in 0.323s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:52 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3 Sep 07 02:27:52 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:52 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df.9ed31750-9714-4c78-ae50-ed4b961dfcc3" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-9ed31750-9714-4c78-ae50-ed4b961dfcc3" released by "_delete_snapshot" :: held 1.655s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" released by "delete_snapshot" :: held 1.681s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:52 devstack cinder-volume[87313]: WARNING cinder.quota [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2058317914 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2058317914, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:27:52 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] Created reservations ['415dddf2-a540-40c2-ab10-36c941f60e0b', '5f856bb1-dd03-4908-89ef-ca2d219f8228', '1bf36a95-3141-4abe-b900-8c1c0b6a105e', '48ba3334-ab70-43cb-b504-23c27086c917'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-72ca33c9-6c0d-4237-bfb1-8d1b34770eec tempest-GroupSnapshotsTest-996806646 None] group_snapshot 30184bd4-2622-4abd-bb9b-0fbf1b1688de: deleted successfully Sep 07 02:27:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:27:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" acquired by "delete_volume" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:27:53 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a53f49-bf03-4935-8e57-e15ff695612d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:27:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:53 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df Sep 07 02:27:53 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:53 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" returned: 0 in 0.389s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:53 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df Sep 07 02:27:53 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:53 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" returned: 0 in 0.258s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-8d4d7a96-ba0a-414d-8686-206fa0f5e3df" released by "delete_volume" :: held 0.744s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:27:53 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Created reservations ['6c0f668a-4018-43a6-a43c-f9769f425803'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:54 devstack cinder-volume[87313]: WARNING cinder.db.api [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2058317914'] Sep 07 02:27:54 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Created reservations ['82fb760c-10c4-47f8-9529-fedf856508b1', '5bfbc77d-4e6f-4eae-bd74-f9dafaeb8ed1', '85e67bd3-b0d5-4d5c-aafb-906d18d333c6', 'd5ac5d4f-de44-4198-96d0-9f7af154bfe7'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:27:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:54 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:27:54 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:54 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.259s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:54 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:27:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-03fa6d78-29e6-48da-ac75-bea04697d459 tempest-GroupSnapshotsTest-996806646 None] Delete group completed successfully. Sep 07 02:27:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7d85b4b2-574f-42f5-a7ae-6a37f50532fe tempest-GroupSnapshotsTest-996806646 None] Group tempest-GroupSnapshotsTest-Group-1989893098: creating Sep 07 02:27:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7d85b4b2-574f-42f5-a7ae-6a37f50532fe tempest-GroupSnapshotsTest-996806646 None] Group tempest-GroupSnapshotsTest-Group-1989893098: created successfully Sep 07 02:27:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7d85b4b2-574f-42f5-a7ae-6a37f50532fe tempest-GroupSnapshotsTest-996806646 None] Create group completed successfully. Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Flow 'volume_create_manager' (13500205-d2e4-477d-9545-d690c817fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b87e0f-16c3-4049-ae26-53fdb7ecd76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b87e0f-16c3-4049-ae26-53fdb7ecd76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1073452268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9dd6741-034f-4ee5-8f7e-0aef8cd5f58f,host='devstack@QuobyteHD#QuobyteHD',id=507a6649-0cd1-41b8-afb6-f56ca85bde01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e0820c0783416c83cfcb3dd756ce61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:27:56Z,use_quota=True,user_id='4652edcee26d409197a81fc0e3efa8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d339c3c-2dd4-4e82-bff8-ea37a3c45060),volume_type_id=6d339c3c-2dd4-4e82-bff8-ea37a3c45060)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd006a0-1378-48d6-941a-589eb32f6e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd006a0-1378-48d6-941a-589eb32f6e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa9c292-a1e7-4967-b15e-efa2dcd29c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa9c292-a1e7-4967-b15e-efa2dcd29c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '507a6649-0cd1-41b8-afb6-f56ca85bde01', 'volume_name': 'volume-507a6649-0cd1-41b8-afb6-f56ca85bde01', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c3f939-453e-4cfa-b94a-598b162a1176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c3f939-453e-4cfa-b94a-598b162a1176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79963cb2-a959-4ad6-889d-ed74ae1e8571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:56 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Volume 507a6649-0cd1-41b8-afb6-f56ca85bde01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-507a6649-0cd1-41b8-afb6-f56ca85bde01', 'volume_size': 1} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9dd6741-034f-4ee5-8f7e-0aef8cd5f58f,created_at=2026-09-07T00:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1073452268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9dd6741-034f-4ee5-8f7e-0aef8cd5f58f,host='devstack@QuobyteHD#QuobyteHD',id=507a6649-0cd1-41b8-afb6-f56ca85bde01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e0820c0783416c83cfcb3dd756ce61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:27:56Z,use_quota=True,user_id='4652edcee26d409197a81fc0e3efa8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d339c3c-2dd4-4e82-bff8-ea37a3c45060),volume_type_id=6d339c3c-2dd4-4e82-bff8-ea37a3c45060)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Creating volume 507a6649-0cd1-41b8-afb6-f56ca85bde01 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:27:56 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:56 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 1073741824 Sep 07 02:27:56 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:56 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 1073741824" returned: 0 in 0.494s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:57 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 Sep 07 02:27:57 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:57 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01" returned: 0 in 0.257s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:27:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79963cb2-a959-4ad6-889d-ed74ae1e8571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-507a6649-0cd1-41b8-afb6-f56ca85bde01', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf6a381-e9b7-4a6b-9eed-dc76f15e1374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:57 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Volume volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 (507a6649-0cd1-41b8-afb6-f56ca85bde01): created successfully Sep 07 02:27:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf6a381-e9b7-4a6b-9eed-dc76f15e1374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Flow 'volume_create_manager' (13500205-d2e4-477d-9545-d690c817fd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-36e8d11e-8a61-4c13-8e88-182492f65487 tempest-GroupSnapshotsTest-996806646 None] Created volume successfully. Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Flow 'volume_create_manager' (042ffe53-8fcb-405b-905c-5031787aba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c07961-5097-4380-b0a0-3bd9970b702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c07961-5097-4380-b0a0-3bd9970b702f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-972915282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9dd6741-034f-4ee5-8f7e-0aef8cd5f58f,host='devstack@QuobyteHD#QuobyteHD',id=cdbf7d20-a113-43c5-88ef-bc498e2fe8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e0820c0783416c83cfcb3dd756ce61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:27:58Z,use_quota=True,user_id='4652edcee26d409197a81fc0e3efa8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d339c3c-2dd4-4e82-bff8-ea37a3c45060),volume_type_id=6d339c3c-2dd4-4e82-bff8-ea37a3c45060)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59944aa6-f7b0-4b1f-9c5e-7e2c832fe90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59944aa6-f7b0-4b1f-9c5e-7e2c832fe90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135ec943-ab66-4673-85ef-d3c67e443045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135ec943-ab66-4673-85ef-d3c67e443045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdbf7d20-a113-43c5-88ef-bc498e2fe8db', 'volume_name': 'volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716928be-b6b6-4c6c-8788-5870bbf668ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716928be-b6b6-4c6c-8788-5870bbf668ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4feab7-2e49-4294-b6da-db38bbc9aece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:58 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Volume cdbf7d20-a113-43c5-88ef-bc498e2fe8db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db', 'volume_size': 1} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9dd6741-034f-4ee5-8f7e-0aef8cd5f58f,created_at=2026-09-07T00:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-972915282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9dd6741-034f-4ee5-8f7e-0aef8cd5f58f,host='devstack@QuobyteHD#QuobyteHD',id=cdbf7d20-a113-43c5-88ef-bc498e2fe8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e0820c0783416c83cfcb3dd756ce61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:27:58Z,use_quota=True,user_id='4652edcee26d409197a81fc0e3efa8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d339c3c-2dd4-4e82-bff8-ea37a3c45060),volume_type_id=6d339c3c-2dd4-4e82-bff8-ea37a3c45060)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Creating volume cdbf7d20-a113-43c5-88ef-bc498e2fe8db {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:27:58 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:58 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db 1073741824 Sep 07 02:27:58 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:58 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db 1073741824" returned: 0 in 0.441s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:27:58 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db Sep 07 02:27:58 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:27:58 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Sep 07 02:27:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db" returned: 0 in 0.268s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:27:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:27:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:27:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4feab7-2e49-4294-b6da-db38bbc9aece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c2ae98-9abb-4bb3-8008-3318c54f0f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:27:59 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Volume volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db (cdbf7d20-a113-43c5-88ef-bc498e2fe8db): created successfully Sep 07 02:27:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c2ae98-9abb-4bb3-8008-3318c54f0f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:27:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Flow 'volume_create_manager' (042ffe53-8fcb-405b-905c-5031787aba6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:27:59 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9dfc860c-a6bd-41e5-a0d9-3d6869f3c1b9 tempest-GroupSnapshotsTest-996806646 None] Created volume successfully. Sep 07 02:27:59 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-89a621c3-6a79-44b5-9cbd-404358af978b tempest-GroupSnapshotsTest-996806646 None] Update group completed successfully. Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Flow 'volume_create_manager' (b0581d72-95b8-468c-998c-487fa71b3d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558c0c53-9684-4c43-95fc-bd188fa1b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558c0c53-9684-4c43-95fc-bd188fa1b05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9703c72c-30fb-403e-85ed-58861e0020f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05116a77eff41898e156b5dd5a1c0b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:01Z,use_quota=True,user_id='d78a90b277934c3c8cbff6c3f794ac4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309edb93-f649-4a0a-b2db-09a76e2330c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309edb93-f649-4a0a-b2db-09a76e2330c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d985ad-e966-42c2-ba58-f181bec83fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d985ad-e966-42c2-ba58-f181bec83fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9703c72c-30fb-403e-85ed-58861e0020f8', 'volume_name': 'volume-9703c72c-30fb-403e-85ed-58861e0020f8', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68733aa7-ed1a-49b8-97c5-f22b77a74876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68733aa7-ed1a-49b8-97c5-f22b77a74876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bf7dcf-ff38-4687-852d-f08dce0b6367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:00 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Volume 9703c72c-30fb-403e-85ed-58861e0020f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9703c72c-30fb-403e-85ed-58861e0020f8', 'volume_size': 1} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9703c72c-30fb-403e-85ed-58861e0020f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05116a77eff41898e156b5dd5a1c0b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:01Z,use_quota=True,user_id='d78a90b277934c3c8cbff6c3f794ac4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Creating volume 9703c72c-30fb-403e-85ed-58861e0020f8 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:28:00 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:28:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:00 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c30345e7-a611-4c11-b580-94fafcf3e122 tempest-GroupSnapshotsTest-996806646 None] Update group completed successfully. Sep 07 02:28:00 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8 1073741824 Sep 07 02:28:00 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:01 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8 1073741824" returned: 0 in 0.401s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:01 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8 Sep 07 02:28:01 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:01 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8" returned: 0 in 0.240s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:28:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bf7dcf-ff38-4687-852d-f08dce0b6367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9703c72c-30fb-403e-85ed-58861e0020f8', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e433189-7f51-4703-a5c6-a12b500ee1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:01 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Volume volume-9703c72c-30fb-403e-85ed-58861e0020f8 (9703c72c-30fb-403e-85ed-58861e0020f8): created successfully Sep 07 02:28:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e433189-7f51-4703-a5c6-a12b500ee1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Flow 'volume_create_manager' (b0581d72-95b8-468c-998c-487fa71b3d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3cb074dd-1e91-4b31-8122-8fceafae98b7 tempest-CinderUnicodeTest-713713057 None] Created volume successfully. Sep 07 02:28:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-51ebd0e6-bf8c-4f49-99ed-289041e8df69 tempest-GroupSnapshotsTest-996806646 None] Update group completed successfully. Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Flow 'volume_create_manager' (990a1c8c-966c-4daf-96d1-e8eac23af159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2118928c-4477-42bf-97c5-27ee8b48cbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2118928c-4477-42bf-97c5-27ee8b48cbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:28:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1563870251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a515cf13-17f5-4148-82a3-b867233eda24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05116a77eff41898e156b5dd5a1c0b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:02Z,use_quota=True,user_id='d78a90b277934c3c8cbff6c3f794ac4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcc0528-de08-4f0a-8bad-f6db95987b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcc0528-de08-4f0a-8bad-f6db95987b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef510b64-baf4-4425-9b05-2bc676a69d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef510b64-baf4-4425-9b05-2bc676a69d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a515cf13-17f5-4148-82a3-b867233eda24', 'volume_name': 'volume-a515cf13-17f5-4148-82a3-b867233eda24', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d91061-13a7-4c0a-acee-1bae9355c8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d91061-13a7-4c0a-acee-1bae9355c8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73313d30-30cc-45bc-9977-8276659e6555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:02 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Volume a515cf13-17f5-4148-82a3-b867233eda24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a515cf13-17f5-4148-82a3-b867233eda24', 'volume_size': 1} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:28:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1563870251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a515cf13-17f5-4148-82a3-b867233eda24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05116a77eff41898e156b5dd5a1c0b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:02Z,use_quota=True,user_id='d78a90b277934c3c8cbff6c3f794ac4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Creating volume a515cf13-17f5-4148-82a3-b867233eda24 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:28:02 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:02 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 1073741824 Sep 07 02:28:02 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:02 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 1073741824" returned: 0 in 0.393s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:02 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 Sep 07 02:28:02 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:02 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24" returned: 0 in 0.265s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73313d30-30cc-45bc-9977-8276659e6555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a515cf13-17f5-4148-82a3-b867233eda24', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a6bbca-673a-46dc-8e35-429678b03f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:03 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Volume volume-a515cf13-17f5-4148-82a3-b867233eda24 (a515cf13-17f5-4148-82a3-b867233eda24): created successfully Sep 07 02:28:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a6bbca-673a-46dc-8e35-429678b03f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Flow 'volume_create_manager' (990a1c8c-966c-4daf-96d1-e8eac23af159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:03 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ef56f7a6-b938-40d7-aef7-eaf001450f43 tempest-CinderUnicodeTest-713713057 None] Created volume successfully. Sep 07 02:28:03 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0fa3445c-0a57-4d7a-b1f3-d4a3e6068b7b tempest-GroupSnapshotsTest-996806646 None] Update group completed successfully. Sep 07 02:28:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] Creating offline snapshot 19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 of volume a515cf13-17f5-4148-82a3-b867233eda24 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:28:03 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[343cc0fd-8ae1-4fd5-b366-7a8670845987]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:03 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 Sep 07 02:28:03 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:03 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24" returned: 0 in 0.356s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:03 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 1G Sep 07 02:28:03 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:04 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 1G" returned: 0 in 0.389s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a515cf13-17f5-4148-82a3-b867233eda24 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:04 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a515cf13-17f5-4148-82a3-b867233eda24 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 Sep 07 02:28:04 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:04 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a515cf13-17f5-4148-82a3-b867233eda24 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46" returned: 0 in 0.306s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:04 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 is being set with open permissions: ugo+rw Sep 07 02:28:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:04 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] GroupSnapshot 21fa826c-c4ff-4b1d-9da7-5970c8e26970: creating. Sep 07 02:28:04 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 Sep 07 02:28:04 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Group snapshot 21fa826c-c4ff-4b1d-9da7-5970c8e26970: creating. {{(pid=87313) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 02:28:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:04 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46" returned: 0 in 0.258s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:04 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.info Sep 07 02:28:04 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:05 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.info" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:05 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.info is being set with open permissions: ugo+rw Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:05 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.info Sep 07 02:28:05 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:05 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.info" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.752s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Creating offline snapshot 6c538ef8-0a22-448d-89d1-308fba09e27f of volume cdbf7d20-a113-43c5-88ef-bc498e2fe8db {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:28:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b5d2da2c-63b5-4325-bd1f-1b037f61a747 tempest-CinderUnicodeTest-713713057 None] Create snapshot completed successfully Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d902776-68db-420d-ab03-446cb0da6c77]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:05 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db Sep 07 02:28:05 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Acquiring lock "cinder-19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Lock "cinder-19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Acquiring lock "cinder-quobyte-a515cf13-17f5-4148-82a3-b867233eda24" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Lock "cinder-quobyte-a515cf13-17f5-4148-82a3-b867233eda24" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Acquiring lock "cinder-quobyte-19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Lock "cinder-quobyte-19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Deleting offline snapshot 19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 of volume a515cf13-17f5-4148-82a3-b867233eda24 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] snapshot_file for this snap is: volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e794d6b8-119a-4bb8-86dd-da18c687b989]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:05 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db" returned: 0 in 0.373s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:05 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f 1G Sep 07 02:28:05 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:05 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 Sep 07 02:28:05 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:06 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46" returned: 0 in 0.386s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a515cf13-17f5-4148-82a3-b867233eda24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77ee5a4-4d2c-462b-96e2-6aaca7d194bb]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:06 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f 1G" returned: 0 in 0.411s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:06 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f Sep 07 02:28:06 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:06 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 Sep 07 02:28:06 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:06 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f" returned: 0 in 0.301s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:06 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:06 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24" returned: 0 in 0.355s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:06 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f Sep 07 02:28:06 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:06 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 Sep 07 02:28:06 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:06 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f" returned: 0 in 0.265s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:06 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.info Sep 07 02:28:06 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:06 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46" returned: 0 in 0.353s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:06 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46 Sep 07 02:28:06 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:06 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.info" returned: 0 in 0.253s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:06 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:28:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:07 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.info Sep 07 02:28:07 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:07 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24.19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46" returned: 0 in 0.255s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Lock "cinder-quobyte-19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46" released by "_delete_snapshot" :: held 1.450s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Lock "cinder-quobyte-a515cf13-17f5-4148-82a3-b867233eda24" released by "delete_snapshot" :: held 1.473s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Created reservations ['20d4bc89-b047-4bc0-a8f9-86d44d8f5852', '9bf6634b-b173-4822-8816-07055977aa68', '66893450-4f85-4643-9979-0b9a9d280eb7', '087f66dd-465c-4088-8c8a-66cfac59ae37'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:07 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Delete snapshot completed successfully. Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9dbfa0e7-b999-4373-9ff4-416aa2d249bc tempest-CinderUnicodeTest-713713057 None] Lock "cinder-19f3e3f7-66c7-4d5c-ae34-3bb826d1fb46-delete_snapshot" released by "delete_snapshot" :: held 1.609s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:07 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.info" returned: 0 in 0.253s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Creating offline snapshot 72c86811-d347-4676-ac28-135ffa4153a2 of volume 507a6649-0cd1-41b8-afb6-f56ca85bde01 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[801abfa1-2cef-420f-be6c-7edfe0d441a8]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:07 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 Sep 07 02:28:07 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:07 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01" returned: 0 in 0.354s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:07 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 1G Sep 07 02:28:07 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Acquiring lock "cinder-a515cf13-17f5-4148-82a3-b867233eda24-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Lock "cinder-a515cf13-17f5-4148-82a3-b867233eda24-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Acquiring lock "cinder-quobyte-a515cf13-17f5-4148-82a3-b867233eda24" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Lock "cinder-quobyte-a515cf13-17f5-4148-82a3-b867233eda24" acquired by "delete_volume" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ade80bf-45f8-46f4-a43f-61f0419252ff]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:07 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 Sep 07 02:28:07 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:08 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 1G" returned: 0 in 0.419s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:08 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 Sep 07 02:28:08 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:08 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24" returned: 0 in 0.372s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:08 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24 Sep 07 02:28:08 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:08 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2" returned: 0 in 0.282s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:08 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:08 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 Sep 07 02:28:08 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:08 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a515cf13-17f5-4148-82a3-b867233eda24" returned: 0 in 0.256s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Lock "cinder-quobyte-a515cf13-17f5-4148-82a3-b867233eda24" released by "delete_volume" :: held 0.683s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Created reservations ['cc233b45-e78e-42fb-8efe-8c8dad6dba3f', 'd5551245-098b-4dd6-a25f-c915208ba127', 'f0572de5-467c-465d-840d-1104db92579e', '37493c78-0362-4e76-a740-60d7fb572b06'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:08 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2" returned: 0 in 0.265s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:08 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.info Sep 07 02:28:08 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:08 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:28:08 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:08 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.info" returned: 0 in 0.258s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:08 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:08 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.info Sep 07 02:28:08 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:08 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.276s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:28:08 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Deleted volume successfully. Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Acquiring lock "cinder-9703c72c-30fb-403e-85ed-58861e0020f8-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3d4c362f-690f-4dc6-a789-2a4f591a85be tempest-CinderUnicodeTest-713713057 None] Lock "cinder-a515cf13-17f5-4148-82a3-b867233eda24-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Lock "cinder-9703c72c-30fb-403e-85ed-58861e0020f8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Acquiring lock "cinder-quobyte-9703c72c-30fb-403e-85ed-58861e0020f8" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Lock "cinder-quobyte-9703c72c-30fb-403e-85ed-58861e0020f8" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b4b8a8-cbeb-4d19-bee3-528379bd70d0]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:09 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.info" returned: 0 in 0.274s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:09 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8 Sep 07 02:28:09 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:09 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c5f5a2ea-88c8-40f5-adb7-c263589c8534 tempest-GroupSnapshotsTest-996806646 None] group_snapshot 21fa826c-c4ff-4b1d-9da7-5970c8e26970: created successfully Sep 07 02:28:09 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8" returned: 0 in 0.381s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:09 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8 Sep 07 02:28:09 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:09 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9703c72c-30fb-403e-85ed-58861e0020f8" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Lock "cinder-quobyte-9703c72c-30fb-403e-85ed-58861e0020f8" released by "delete_volume" :: held 0.662s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Created reservations ['f9174a5d-1cea-4cd2-8947-c459b348d184', '47275be5-99b2-4525-8110-6dedab1d6d75', 'a15c1bfc-59ed-46c3-a0c0-c81819347cad', 'baacc59f-6dc1-4a03-acba-794f4659ee8d'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:09 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:28:09 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:09 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] group_snapshot 21fa826c-c4ff-4b1d-9da7-5970c8e26970: deleting Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] group_snapshot 21fa826c-c4ff-4b1d-9da7-5970c8e26970: deleting {{(pid=87313) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-cdbf7d20-a113-43c5-88ef-bc498e2fe8db" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-cdbf7d20-a113-43c5-88ef-bc498e2fe8db" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-6c538ef8-0a22-448d-89d1-308fba09e27f" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-6c538ef8-0a22-448d-89d1-308fba09e27f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Deleting offline snapshot 6c538ef8-0a22-448d-89d1-308fba09e27f of volume cdbf7d20-a113-43c5-88ef-bc498e2fe8db {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:28:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] snapshot_file for this snap is: volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:28:10 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c96247a-7852-475e-a6e0-4603bcb2a1c9]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:10 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.262s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:10 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:28:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Deleted volume successfully. Sep 07 02:28:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a806e564-bdf8-4403-a8fa-68d0a275d30e tempest-CinderUnicodeTest-713713057 None] Lock "cinder-9703c72c-30fb-403e-85ed-58861e0020f8-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:10 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f Sep 07 02:28:10 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:10 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f" returned: 0 in 0.424s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:28:10 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a15f577-6a52-4fb5-ab89-c3ea0b7b11ca]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:10 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db Sep 07 02:28:10 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:10 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db" returned: 0 in 0.381s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:10 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f Sep 07 02:28:10 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:11 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f" returned: 0 in 0.359s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:11 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f Sep 07 02:28:11 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:11 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db.6c538ef8-0a22-448d-89d1-308fba09e27f" returned: 0 in 0.260s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-6c538ef8-0a22-448d-89d1-308fba09e27f" released by "_delete_snapshot" :: held 1.518s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-cdbf7d20-a113-43c5-88ef-bc498e2fe8db" released by "delete_snapshot" :: held 1.545s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-507a6649-0cd1-41b8-afb6-f56ca85bde01" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-507a6649-0cd1-41b8-afb6-f56ca85bde01" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-72c86811-d347-4676-ac28-135ffa4153a2" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-72c86811-d347-4676-ac28-135ffa4153a2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Deleting offline snapshot 72c86811-d347-4676-ac28-135ffa4153a2 of volume 507a6649-0cd1-41b8-afb6-f56ca85bde01 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] snapshot_file for this snap is: volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[01caa30d-233d-451f-a71c-3929a6940a3b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:11 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 Sep 07 02:28:11 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:11 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2" returned: 0 in 0.359s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-507a6649-0cd1-41b8-afb6-f56ca85bde01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ed589d-9de5-49d7-9d0b-024ec8c7eb4d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:12 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 Sep 07 02:28:12 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:12 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01" returned: 0 in 0.370s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:12 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 Sep 07 02:28:12 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:12 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2" returned: 0 in 0.349s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:12 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2 Sep 07 02:28:12 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:12 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01.72c86811-d347-4676-ac28-135ffa4153a2" returned: 0 in 0.254s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-72c86811-d347-4676-ac28-135ffa4153a2" released by "_delete_snapshot" :: held 1.425s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-507a6649-0cd1-41b8-afb6-f56ca85bde01" released by "delete_snapshot" :: held 1.447s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:13 devstack cinder-volume[87313]: WARNING cinder.quota [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-692610970 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-692610970, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:28:13 devstack cinder-volume[87313]: WARNING cinder.quota [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-692610970 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-692610970, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Created reservations ['510b6355-40fc-4ba2-9093-e6c36b73d0df', 'f5a883f8-e4fd-49ad-a220-835789141402', '265d8bd5-ab0e-4b4b-aeec-f3dc1112fa6a', '838508b8-6cdf-4aa2-ae25-097b9539346b'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] Created reservations ['ac5b3f62-10c1-4a76-825f-f94ebe9c26a7', '19366ce3-8a75-4921-8fb6-b32417a7bf4a', '9cb92fec-e642-4e65-b5be-4bdfba05ac99', 'c0cc864d-96b2-48ac-95e7-765882a12dd8'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-de261cec-7d7f-4449-93f8-475419b6140b tempest-GroupSnapshotsTest-996806646 None] group_snapshot 21fa826c-c4ff-4b1d-9da7-5970c8e26970: deleted successfully Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Flow 'volume_create_manager' (98070e50-f8d2-49f5-a2c6-299bf752efd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc0578c-1fdc-4949-839b-220ca7861df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc0578c-1fdc-4949-839b-220ca7861df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825756447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd02035-9be9-416b-b4fa-3cce9da6a8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68503d85ad9e452e8e5d8065a1f18b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:14Z,use_quota=True,user_id='a6ba982d2ff0402eb630582f2668a4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26e82b0-28c6-4476-b1bf-98582e69fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26e82b0-28c6-4476-b1bf-98582e69fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d8a47a-4402-40d4-bc0c-c5f496abd42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d8a47a-4402-40d4-bc0c-c5f496abd42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd02035-9be9-416b-b4fa-3cce9da6a8b7', 'volume_name': 'volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdf3f97-6438-4dfc-bafa-4654653c0aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdf3f97-6438-4dfc-bafa-4654653c0aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5014c6f0-2e39-42cb-8108-fceaa4270b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:13 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Volume 4cd02035-9be9-416b-b4fa-3cce9da6a8b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7', 'volume_size': 1} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825756447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd02035-9be9-416b-b4fa-3cce9da6a8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68503d85ad9e452e8e5d8065a1f18b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:14Z,use_quota=True,user_id='a6ba982d2ff0402eb630582f2668a4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Creating volume 4cd02035-9be9-416b-b4fa-3cce9da6a8b7 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:28:13 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:13 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7 1073741824 Sep 07 02:28:13 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-507a6649-0cd1-41b8-afb6-f56ca85bde01" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-507a6649-0cd1-41b8-afb6-f56ca85bde01" acquired by "delete_volume" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3a3451-6888-4e51-ac40-2d239615f23a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:13 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 Sep 07 02:28:13 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:14 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7 1073741824" returned: 0 in 0.426s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:14 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7 Sep 07 02:28:14 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:14 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01" returned: 0 in 0.373s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:14 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01 Sep 07 02:28:14 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:14 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7" returned: 0 in 0.265s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5014c6f0-2e39-42cb-8108-fceaa4270b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dd2a6c-01a5-4d5d-be75-335059f531bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:14 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Volume volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7 (4cd02035-9be9-416b-b4fa-3cce9da6a8b7): created successfully Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dd2a6c-01a5-4d5d-be75-335059f531bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Flow 'volume_create_manager' (98070e50-f8d2-49f5-a2c6-299bf752efd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:14 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:14 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f62ad36f-bd31-496c-8a28-90984885f769 tempest-ProjectReaderTests-81773825 None] Created volume successfully. Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-507a6649-0cd1-41b8-afb6-f56ca85bde01" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-507a6649-0cd1-41b8-afb6-f56ca85bde01" released by "delete_volume" :: held 0.682s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-cdbf7d20-a113-43c5-88ef-bc498e2fe8db" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-cdbf7d20-a113-43c5-88ef-bc498e2fe8db" acquired by "delete_volume" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a52ac60-9d39-4f19-a1f5-ea38f0f86bb3]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:14 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db Sep 07 02:28:14 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Acquiring lock "cinder-4cd02035-9be9-416b-b4fa-3cce9da6a8b7-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Lock "cinder-4cd02035-9be9-416b-b4fa-3cce9da6a8b7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Acquiring lock "cinder-quobyte-4cd02035-9be9-416b-b4fa-3cce9da6a8b7" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Lock "cinder-quobyte-4cd02035-9be9-416b-b4fa-3cce9da6a8b7" acquired by "delete_volume" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9fc7f2-8db8-4bc1-b5a6-5cbb40b35ac1]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:14 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db" returned: 0 in 0.393s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:14 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db Sep 07 02:28:14 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:15 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7 Sep 07 02:28:15 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:15 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-cdbf7d20-a113-43c5-88ef-bc498e2fe8db" returned: 0 in 0.266s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-cdbf7d20-a113-43c5-88ef-bc498e2fe8db" released by "delete_volume" :: held 0.715s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:15 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7" returned: 0 in 0.396s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Created reservations ['a8e9e6cf-a730-46e9-82b4-280cdc5cafe7'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:15 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7 Sep 07 02:28:15 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:15 devstack cinder-volume[87313]: WARNING cinder.quota [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-692610970 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-692610970, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Created reservations ['59be8f1c-8fdf-4ee4-bd47-ed95681da2c0', 'a42ec847-0d7e-49bb-8dfc-5bfcc8926bb2', '4b69fddf-80bc-498b-902d-00bc87d32b93', '364538b5-a712-4465-b241-1d9cb95db8aa'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Created reservations ['098244b3-3c97-43ae-9a2c-0c62154ce780', '729b668b-f54c-46f9-b618-a2f574d95ca7', '5a470d41-3795-4e1c-a20f-30be94919f4b', 'a9a850b6-f8c4-4afa-a028-023c3b864ffc'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:15 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4cd02035-9be9-416b-b4fa-3cce9da6a8b7" returned: 0 in 0.258s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Lock "cinder-quobyte-4cd02035-9be9-416b-b4fa-3cce9da6a8b7" released by "delete_volume" :: held 0.697s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:15 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:28:15 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Created reservations ['7f5d06d5-ed58-457f-8cb8-4acc4b2a26b9', '9f861738-e5eb-49bb-a675-409d0953ef63', '447033bc-b101-4a4d-b4df-8ebba987be26', '0b76a8c0-2342-49bd-9adb-70d34fae454a'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:15 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:28:15 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:15 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.250s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:28:15 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1f1f6afe-577a-4b10-a250-71139f485c98 tempest-GroupSnapshotsTest-996806646 None] Delete group completed successfully. Sep 07 02:28:15 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:28:15 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Deleted volume successfully. Sep 07 02:28:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8da76251-0d75-41d4-a039-4c3ea4921c31 tempest-ProjectReaderTests-81773825 None] Lock "cinder-4cd02035-9be9-416b-b4fa-3cce9da6a8b7-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Flow 'volume_create_manager' (aa7f65b0-7f72-4463-a955-0d4eafe360c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f335fcd0-8bb4-47f8-94e1-5a033d95cff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f335fcd0-8bb4-47f8-94e1-5a033d95cff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561914678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d0f9a5-616a-4da0-811b-389d8e3a74bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68503d85ad9e452e8e5d8065a1f18b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:16Z,use_quota=True,user_id='a6ba982d2ff0402eb630582f2668a4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62648c4-56aa-43c2-9407-28e1b4fcbbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62648c4-56aa-43c2-9407-28e1b4fcbbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bba023f-82ad-43f4-b276-32e20fc76a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bba023f-82ad-43f4-b276-32e20fc76a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d0f9a5-616a-4da0-811b-389d8e3a74bd', 'volume_name': 'volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71999af5-7935-42b3-a9b0-d00552168b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71999af5-7935-42b3-a9b0-d00552168b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715eb863-9b2a-4fac-93b7-75b34d9f3ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:16 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Volume 23d0f9a5-616a-4da0-811b-389d8e3a74bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd', 'volume_size': 1} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561914678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d0f9a5-616a-4da0-811b-389d8e3a74bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68503d85ad9e452e8e5d8065a1f18b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:16Z,use_quota=True,user_id='a6ba982d2ff0402eb630582f2668a4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Creating volume 23d0f9a5-616a-4da0-811b-389d8e3a74bd {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:28:16 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:16 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd 1073741824 Sep 07 02:28:16 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:16 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9b9797e8-78bf-42ea-94de-d5d9b89b3a78 tempest-GroupSnapshotsTest-996806646 None] Group tempest-GroupSnapshotsTest-Group-1909052731: creating Sep 07 02:28:16 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9b9797e8-78bf-42ea-94de-d5d9b89b3a78 tempest-GroupSnapshotsTest-996806646 None] Group tempest-GroupSnapshotsTest-Group-1909052731: created successfully Sep 07 02:28:16 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9b9797e8-78bf-42ea-94de-d5d9b89b3a78 tempest-GroupSnapshotsTest-996806646 None] Create group completed successfully. Sep 07 02:28:16 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd 1073741824" returned: 0 in 0.415s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:16 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd Sep 07 02:28:16 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:17 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715eb863-9b2a-4fac-93b7-75b34d9f3ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc007ac-3880-48c0-9ac5-585797c30071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:17 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Volume volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd (23d0f9a5-616a-4da0-811b-389d8e3a74bd): created successfully Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc007ac-3880-48c0-9ac5-585797c30071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Flow 'volume_create_manager' (aa7f65b0-7f72-4463-a955-0d4eafe360c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:17 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f4fb0519-e006-48a5-8141-ad66f7f4cf69 tempest-ProjectReaderTests-81773825 None] Created volume successfully. Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Acquiring lock "cinder-23d0f9a5-616a-4da0-811b-389d8e3a74bd-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Lock "cinder-23d0f9a5-616a-4da0-811b-389d8e3a74bd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Acquiring lock "cinder-quobyte-23d0f9a5-616a-4da0-811b-389d8e3a74bd" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Lock "cinder-quobyte-23d0f9a5-616a-4da0-811b-389d8e3a74bd" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[72342fbc-3fee-433a-9c8a-28c174e865c3]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:17 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd Sep 07 02:28:17 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:17 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd" returned: 0 in 0.364s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:17 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd Sep 07 02:28:17 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:28:18 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Flow 'volume_create_manager' (7d7896ce-3a37-4fca-9cb4-e3add0348740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6687c8a3-500f-4fae-9b5c-6188ac99f20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-23d0f9a5-616a-4da0-811b-389d8e3a74bd" returned: 0 in 0.309s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6687c8a3-500f-4fae-9b5c-6188ac99f20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-893466040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bffd6250-7175-4852-96a2-befc7ee10fe0,host='devstack@QuobyteHD#QuobyteHD',id=3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e0820c0783416c83cfcb3dd756ce61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:18Z,use_quota=True,user_id='4652edcee26d409197a81fc0e3efa8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a458b0e3-65fe-418a-87f1-46967d7e6b2f),volume_type_id=a458b0e3-65fe-418a-87f1-46967d7e6b2f)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8a674f-f230-49af-9b4a-7c7c6b6fb0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8a674f-f230-49af-9b4a-7c7c6b6fb0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5984cbb-bfd9-4fa8-a330-5479d0d7d96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5984cbb-bfd9-4fa8-a330-5479d0d7d96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7', 'volume_name': 'volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89310a3a-04db-49d9-b9c4-c6ebbaba94ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89310a3a-04db-49d9-b9c4-c6ebbaba94ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3129b9-fb1e-4415-957a-9f79db9f0027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:18 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Volume 3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7', 'volume_size': 1} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bffd6250-7175-4852-96a2-befc7ee10fe0,created_at=2026-09-07T00:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-893466040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bffd6250-7175-4852-96a2-befc7ee10fe0,host='devstack@QuobyteHD#QuobyteHD',id=3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e0820c0783416c83cfcb3dd756ce61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:18Z,use_quota=True,user_id='4652edcee26d409197a81fc0e3efa8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a458b0e3-65fe-418a-87f1-46967d7e6b2f),volume_type_id=a458b0e3-65fe-418a-87f1-46967d7e6b2f)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Creating volume 3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:28:18 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Lock "cinder-quobyte-23d0f9a5-616a-4da0-811b-389d8e3a74bd" released by "delete_volume" :: held 0.771s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:18 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 1073741824 Sep 07 02:28:18 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Created reservations ['87e0f75a-5eb1-4e45-ba1d-9037ff4cd883', '2f07fcdb-a577-42f6-91f0-b622ad3e087a', '93efb94e-1939-4d6a-b52e-9c3de9b3a59f', 'a1515f39-d3d0-4a5b-a7d4-ec68574c894f'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:18 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:28:18 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:18 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.289s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:28:18 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Deleted volume successfully. Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a880cfd-e8c2-4819-8f96-4850ae884b85 tempest-ProjectReaderTests-81773825 None] Lock "cinder-23d0f9a5-616a-4da0-811b-389d8e3a74bd-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:18 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 1073741824" returned: 0 in 0.475s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:18 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 Sep 07 02:28:18 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:19 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7" returned: 0 in 0.253s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3129b9-fb1e-4415-957a-9f79db9f0027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1fd329-d292-44ce-ad68-62820f449ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:19 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Volume volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 (3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7): created successfully Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1fd329-d292-44ce-ad68-62820f449ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Flow 'volume_create_manager' (7d7896ce-3a37-4fca-9cb4-e3add0348740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:19 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c0a74410-627c-48a1-a88c-d54493ae2f60 tempest-GroupSnapshotsTest-996806646 None] Created volume successfully. Sep 07 02:28:19 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] GroupSnapshot fb591aa8-cb3c-4b40-92f7-d31c5405df47: creating. Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] Group snapshot fb591aa8-cb3c-4b40-92f7-d31c5405df47: creating. {{(pid=87313) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] Creating offline snapshot b510b1b7-b959-4974-8dcc-eadeb25917c0 of volume 3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6928e0-f472-4b3b-96ef-487668f90378]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:19 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 Sep 07 02:28:19 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:20 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7" returned: 0 in 0.373s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:20 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 1G Sep 07 02:28:20 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:20 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 1G" returned: 0 in 0.390s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:20 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 Sep 07 02:28:20 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:20 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0" returned: 0 in 0.323s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:20 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:28:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:20 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 Sep 07 02:28:20 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:20 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:21 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.info Sep 07 02:28:21 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:21 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.info" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:21 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:21 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.info Sep 07 02:28:21 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:21 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.info" returned: 0 in 0.233s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:21 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0fad0368-dfbf-4192-a561-a7ed38ec16ea tempest-GroupSnapshotsTest-996806646 None] group_snapshot fb591aa8-cb3c-4b40-92f7-d31c5405df47: created successfully Sep 07 02:28:21 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] group_snapshot fb591aa8-cb3c-4b40-92f7-d31c5405df47: deleting Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] group_snapshot fb591aa8-cb3c-4b40-92f7-d31c5405df47: deleting {{(pid=87313) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-b510b1b7-b959-4974-8dcc-eadeb25917c0" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-b510b1b7-b959-4974-8dcc-eadeb25917c0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Deleting offline snapshot b510b1b7-b959-4974-8dcc-eadeb25917c0 of volume 3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] snapshot_file for this snap is: volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b0649f-44ea-487e-8a07-9c7dc7df2a40]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:22 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 Sep 07 02:28:22 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:22 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0" returned: 0 in 0.353s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:28:22 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c40bc6-a953-4bf5-8c5d-218f7c190364]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:22 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 Sep 07 02:28:22 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:22 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7" returned: 0 in 0.351s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:22 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 Sep 07 02:28:22 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:23 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0" returned: 0 in 0.317s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:23 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0 Sep 07 02:28:23 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:23 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7.b510b1b7-b959-4974-8dcc-eadeb25917c0" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-b510b1b7-b959-4974-8dcc-eadeb25917c0" released by "_delete_snapshot" :: held 1.349s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7" released by "delete_snapshot" :: held 1.369s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:23 devstack cinder-volume[87313]: WARNING cinder.quota [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-400778708 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-400778708, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:28:23 devstack cinder-volume[87313]: WARNING cinder.quota [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-400778708 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-400778708, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:28:23 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] Created reservations ['c5eaeb00-0d78-4b76-8dd3-22b46e2651d4', 'e5590ed7-12a2-4c08-b1a4-3eb55ce089af', 'cc5f66c9-602c-489a-a714-1d68b0da1b47', 'bd06ef39-328e-48a9-96e9-5865e3c8a3bf'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:23 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4dd91390-7d41-4fae-b678-61bc41fabfd8 tempest-GroupSnapshotsTest-996806646 None] group_snapshot fb591aa8-cb3c-4b40-92f7-d31c5405df47: deleted successfully Sep 07 02:28:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "cinder-quobyte-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:24 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9513b50-10f8-4460-8d3c-66537201efd3]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:24 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 Sep 07 02:28:24 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:24 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7" returned: 0 in 0.345s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:24 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7 Sep 07 02:28:24 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:25 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7" returned: 0 in 0.241s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Lock "cinder-quobyte-3b0335b9-ea2d-4ac9-8a45-bcfa3ad615e7" released by "delete_volume" :: held 0.638s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Created reservations ['6d893410-a079-4f1b-91ac-f25567dd9435'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:25 devstack cinder-volume[87313]: WARNING cinder.quota [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-400778708 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-400778708, it is now deprecated. Please use the default quota class for default quota. Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Created reservations ['b63d5257-0fb1-4caf-9ecc-bf6b549ff947', '06e82106-710f-4a40-b7b6-b8895fd392ff', '7014a30b-9f26-4aef-b9c6-9412310b15d5', '26fdd8ce-c92f-4c1e-b0b1-e9816f17a976'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:25 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:28:25 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:25 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.237s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:25 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:28:25 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-be1572c9-ab40-4d8a-a36e-ecac44a837f7 tempest-GroupSnapshotsTest-996806646 None] Delete group completed successfully. Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:26 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:28:26 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:26 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:28:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:28:35 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=152,cinder:UPDATE=171,cinder:INSERT=47,cinder:DELETE=7 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:28:35 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=181,cinder:SELECT=169,cinder:INSERT=39,cinder:DELETE=8 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Flow 'volume_create_manager' (0a081c62-c8f9-43d0-b348-269fd0fdf9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1b68a0-7105-4ef3-8bc9-06625b8c7595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1b68a0-7105-4ef3-8bc9-06625b8c7595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-133722110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac17eaa92ea545c2b004c330345a6045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:49Z,use_quota=True,user_id='71fde728171c458e816584c0c0b930b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cdd034-fe9c-4b48-9129-ee26deb29269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cdd034-fe9c-4b48-9129-ee26deb29269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126df57f-2a59-4b2d-b72d-9fa853a4db25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126df57f-2a59-4b2d-b72d-9fa853a4db25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e', 'volume_name': 'volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2523d05a-d962-454f-a932-d9a80126bad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2523d05a-d962-454f-a932-d9a80126bad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc8227c-9eaa-4cf9-83bf-9b9b26370c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:49 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Volume 7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e', 'volume_size': 1} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-133722110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac17eaa92ea545c2b004c330345a6045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:28:49Z,use_quota=True,user_id='71fde728171c458e816584c0c0b930b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Creating volume 7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:28:49 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:49 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e 1073741824 Sep 07 02:28:49 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:49 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e 1073741824" returned: 0 in 0.396s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:49 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e Sep 07 02:28:49 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:49 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e" returned: 0 in 0.252s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc8227c-9eaa-4cf9-83bf-9b9b26370c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7298fea6-1eda-47ac-8ce9-3b0e84c48c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:28:49 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Volume volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e (7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e): created successfully Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7298fea6-1eda-47ac-8ce9-3b0e84c48c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:28:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Flow 'volume_create_manager' (0a081c62-c8f9-43d0-b348-269fd0fdf9a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:28:49 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9d4b9b78-3cb5-46d4-8b1a-9b1c44e9d42d tempest-AbsoluteLimitsTests-1901006709 None] Created volume successfully. Sep 07 02:28:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Acquiring lock "cinder-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Lock "cinder-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Acquiring lock "cinder-quobyte-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:28:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Lock "cinder-quobyte-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:28:50 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed2a47d-73b5-4087-9a5e-bb1075c1558a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:28:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:50 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e Sep 07 02:28:50 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:50 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e" returned: 0 in 0.357s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:50 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e Sep 07 02:28:50 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:50 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e" returned: 0 in 0.237s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Lock "cinder-quobyte-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e" released by "delete_volume" :: held 0.631s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:28:51 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Created reservations ['51702969-1da2-4a40-9c31-add31dbe418d', 'babcc8d0-f9bb-4719-b2ae-7b00569379ca', '61805b4c-d01e-4cb4-a9cc-bccad701e132', '09d5e9be-f031-4533-9872-f78518f6d19c'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:28:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:28:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:28:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:28:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:28:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:28:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:28:51 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:28:51 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:28:51 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 07 02:28:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.237s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:28:51 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:28:51 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Deleted volume successfully. Sep 07 02:28:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b24c8013-f576-44d4-9577-4e7e2201caff tempest-AbsoluteLimitsTests-1901006709 None] Lock "cinder-7ce6cf25-d16f-4f7b-8416-2b6fc70b0c9e-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:29:01 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=9,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:29:01 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Flow 'volume_create_manager' (5a9b4fd0-9d84-4950-9408-eb918565515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bedbe2c-d496-4dde-bd72-2be5052d9263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bedbe2c-d496-4dde-bd72-2be5052d9263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-583701256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462a0d62-d5db-4dac-9f47-75396ec5ea57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0f9da5808d4979a0ba767004935f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:29:04Z,use_quota=True,user_id='292a658ecb6f4d27b705e9d9c2a553d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eef8e1-0af4-410e-8ede-b5872f68987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eef8e1-0af4-410e-8ede-b5872f68987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b24d9c-d607-4909-a6a5-e1cd9918b200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b24d9c-d607-4909-a6a5-e1cd9918b200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '462a0d62-d5db-4dac-9f47-75396ec5ea57', 'volume_name': 'volume-462a0d62-d5db-4dac-9f47-75396ec5ea57', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295a0be2-5c31-4b35-95c3-c6c074777f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295a0be2-5c31-4b35-95c3-c6c074777f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a18fe0-32b6-40e9-a68b-6d4836e20d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:29:04 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Volume 462a0d62-d5db-4dac-9f47-75396ec5ea57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-462a0d62-d5db-4dac-9f47-75396ec5ea57', 'volume_size': 1} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-583701256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462a0d62-d5db-4dac-9f47-75396ec5ea57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad0f9da5808d4979a0ba767004935f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:29:04Z,use_quota=True,user_id='292a658ecb6f4d27b705e9d9c2a553d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Creating volume 462a0d62-d5db-4dac-9f47-75396ec5ea57 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:29:04 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:04 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 1073741824 Sep 07 02:29:04 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:04 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 1073741824" returned: 0 in 0.417s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:04 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 Sep 07 02:29:04 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:05 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57" returned: 0 in 0.236s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:29:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:29:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a18fe0-32b6-40e9-a68b-6d4836e20d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462a0d62-d5db-4dac-9f47-75396ec5ea57', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:29:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b447993d-dfd6-434d-91ae-593f9a1e405d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:29:05 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Volume volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 (462a0d62-d5db-4dac-9f47-75396ec5ea57): created successfully Sep 07 02:29:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b447993d-dfd6-434d-91ae-593f9a1e405d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:29:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Flow 'volume_create_manager' (5a9b4fd0-9d84-4950-9408-eb918565515d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:29:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a717b32c-dc21-4592-9999-1e8a31ea535f tempest-VolumesActionsTest-2031261993 None] Created volume successfully. Sep 07 02:29:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75e36082-93aa-447a-8396-7649c2db130d tempest-VolumesActionsTest-2031261993 None] Acquiring lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57" by "attach_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:29:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75e36082-93aa-447a-8396-7649c2db130d tempest-VolumesActionsTest-2031261993 None] Lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57" acquired by "attach_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:29:12 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-75e36082-93aa-447a-8396-7649c2db130d tempest-VolumesActionsTest-2031261993 None] Attaching volume 462a0d62-d5db-4dac-9f47-75396ec5ea57 to instance a63f7867-1eb8-4687-876f-179592e29aee at mountpoint /dev/vdb on host None. Sep 07 02:29:12 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-75e36082-93aa-447a-8396-7649c2db130d tempest-VolumesActionsTest-2031261993 None] Attach volume completed successfully. Sep 07 02:29:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75e36082-93aa-447a-8396-7649c2db130d tempest-VolumesActionsTest-2031261993 None] Lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57" released by "attach_volume" :: held 0.097s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:29:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a382381e-02a5-4074-a332-36f012a0dfa3 tempest-VolumesActionsTest-2031261993 None] Acquiring lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57-detach_volume" by "detach_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:29:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a382381e-02a5-4074-a332-36f012a0dfa3 tempest-VolumesActionsTest-2031261993 None] Lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:29:12 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a382381e-02a5-4074-a332-36f012a0dfa3 tempest-VolumesActionsTest-2031261993 None] Detaching volume 462a0d62-d5db-4dac-9f47-75396ec5ea57 from instance a63f7867-1eb8-4687-876f-179592e29aee. Sep 07 02:29:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a382381e-02a5-4074-a332-36f012a0dfa3 tempest-VolumesActionsTest-2031261993 None] Detach volume completed successfully. Sep 07 02:29:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a382381e-02a5-4074-a332-36f012a0dfa3 tempest-VolumesActionsTest-2031261993 None] Lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:29:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3817f109-34f7-44f8-962a-dcbe6d84df4c tempest-VolumesActionsTest-2031261993 None] Acquiring lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57" by "attach_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:29:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3817f109-34f7-44f8-962a-dcbe6d84df4c tempest-VolumesActionsTest-2031261993 None] Lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57" acquired by "attach_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:29:22 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3817f109-34f7-44f8-962a-dcbe6d84df4c tempest-VolumesActionsTest-2031261993 None] Attaching volume 462a0d62-d5db-4dac-9f47-75396ec5ea57 to instance 8471643c-17f9-495c-abea-99c6276949cd at mountpoint /dev/vdb on host None. Sep 07 02:29:22 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3817f109-34f7-44f8-962a-dcbe6d84df4c tempest-VolumesActionsTest-2031261993 None] Attach volume completed successfully. Sep 07 02:29:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3817f109-34f7-44f8-962a-dcbe6d84df4c tempest-VolumesActionsTest-2031261993 None] Lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57" released by "attach_volume" :: held 0.089s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:29:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a6914507-7178-4f3e-9a49-e8e3b59668a6 tempest-VolumesActionsTest-2031261993 None] Acquiring lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57-detach_volume" by "detach_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:29:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a6914507-7178-4f3e-9a49-e8e3b59668a6 tempest-VolumesActionsTest-2031261993 None] Lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:29:23 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a6914507-7178-4f3e-9a49-e8e3b59668a6 tempest-VolumesActionsTest-2031261993 None] Detaching volume 462a0d62-d5db-4dac-9f47-75396ec5ea57 from instance 8471643c-17f9-495c-abea-99c6276949cd. Sep 07 02:29:23 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a6914507-7178-4f3e-9a49-e8e3b59668a6 tempest-VolumesActionsTest-2031261993 None] Detach volume completed successfully. Sep 07 02:29:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a6914507-7178-4f3e-9a49-e8e3b59668a6 tempest-VolumesActionsTest-2031261993 None] Lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:26 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:29:26 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:26 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.266s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:29:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:29:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:29:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:29:27 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc18c21-7144-492b-bfd5-e4a0e870e826]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:29:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:27 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 Sep 07 02:29:27 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:27 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57" returned: 0 in 0.347s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:27 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ab5ff5-ecc7-4fff-807b-3afb0c7d0d46]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:29:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:27 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 Sep 07 02:29:27 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:28 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57" returned: 0 in 0.346s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.ab9f1eb3-217a-4960-93c6-656baacf63c6towrjunn.img {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:28 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.ab9f1eb3-217a-4960-93c6-656baacf63c6towrjunn.img Sep 07 02:29:28 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:31 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.ab9f1eb3-217a-4960-93c6-656baacf63c6towrjunn.img" returned: 0 in 3.836s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:31 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[62169452-8224-4a31-97f5-845afe6695e4]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:29:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:32 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 Sep 07 02:29:32 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:32 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57" returned: 0 in 0.528s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:32 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.ab9f1eb3-217a-4960-93c6-656baacf63c6towrjunn.img {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:29:32 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] Converted 1024.00 MB image at 266.81 MB/s Sep 07 02:29:32 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] ab9f1eb3-217a-4960-93c6-656baacf63c6 was raw, no need to convert to raw {{(pid=87313) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 02:29:42 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=16,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:29:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.972s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:29:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] Uploaded volume to glance image-id: ab9f1eb3-217a-4960-93c6-656baacf63c6. {{(pid=87313) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 02:29:51 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-02cd27fa-00eb-43ae-96ee-9227866ca6e4 tempest-VolumesActionsTest-2031261993 None] Copy volume to image completed successfully. Sep 07 02:29:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:29:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:29:53 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1dc6c3-f821-49b6-b99c-e41ee834ea09]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:29:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:53 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 Sep 07 02:29:53 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:53 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57" returned: 0 in 0.356s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:53 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a6a15e-4479-476f-8025-3c738ac38664]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:29:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:53 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 Sep 07 02:29:53 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:53 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57" returned: 0 in 0.350s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:53 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img Sep 07 02:29:53 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:57 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img" returned: 0 in 3.918s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:57 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa07d5f3-2f89-4177-a2ff-2f773937278e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:29:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:57 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 Sep 07 02:29:57 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:58 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57" returned: 0 in 0.508s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:58 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57, size 1024.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:29:58 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Converted 1024.00 MB image at 261.30 MB/s Sep 07 02:29:58 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] 955d9115-8386-4214-aa61-278b35636a88 was raw, converting to qcow2 {{(pid=87313) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 07 02:29:58 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddbefcc-5346-4a36-95e9-fd9fea6fdbd5]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:29:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:58 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img Sep 07 02:29:58 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:58 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img" returned: 0 in 0.315s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:58 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img Sep 07 02:29:58 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:58 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img" returned: 1 in 0.325s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:29:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img /opt/stack/data/cinder/conversion/vol_upload_tsdp4zdj {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:59 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img /opt/stack/data/cinder/conversion/vol_upload_tsdp4zdj Sep 07 02:29:59 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:59 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img /opt/stack/data/cinder/conversion/vol_upload_tsdp4zdj" returned: 0 in 0.249s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:29:59 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Image conversion details: src /opt/stack/data/cinder/conversion/462a0d62-d5db-4dac-9f47-75396ec5ea57.temp_image.955d9115-8386-4214-aa61-278b35636a88n2viggo8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_tsdp4zdj {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:29:59 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 07 02:29:59 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f73bf4-d436-42b1-8ff0-5cf6c7e974c9]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:29:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tsdp4zdj {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:29:59 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tsdp4zdj Sep 07 02:29:59 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:29:59 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Sep 07 02:29:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tsdp4zdj" returned: 0 in 0.321s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.606s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Uploaded volume to glance image-id: 955d9115-8386-4214-aa61-278b35636a88. {{(pid=87313) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 02:30:00 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b8e4039b-a20d-49d0-a4ce-0c5dd3bae712 tempest-VolumesActionsTest-2031261993 None] Copy volume to image completed successfully. Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Acquiring lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=22,cinder:INSERT=4,cinder:UPDATE=10 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Acquiring lock "cinder-quobyte-462a0d62-d5db-4dac-9f47-75396ec5ea57" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Lock "cinder-quobyte-462a0d62-d5db-4dac-9f47-75396ec5ea57" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f16a84-8c18-455e-9dd4-12df6df5da70]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:02 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 Sep 07 02:30:02 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:02 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57" returned: 0 in 0.340s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:02 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57 Sep 07 02:30:02 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:02 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-462a0d62-d5db-4dac-9f47-75396ec5ea57" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Lock "cinder-quobyte-462a0d62-d5db-4dac-9f47-75396ec5ea57" released by "delete_volume" :: held 0.619s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Created reservations ['69ab1c6d-9204-46b6-9f71-ca375d43d218', 'bdb5fd6c-928a-4152-9ad4-9f9c0273b6dd', '1f097723-8513-4b52-9172-bc4cec37abfa', '4bb25585-ec98-49ff-93e9-a5418daf6a5d'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:03 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:30:03 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:03 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.235s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:03 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:30:03 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Deleted volume successfully. Sep 07 02:30:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-46a2fc4a-8229-4a23-b7f5-a9ef66f719e8 tempest-VolumesActionsTest-2031261993 None] Lock "cinder-462a0d62-d5db-4dac-9f47-75396ec5ea57-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:30:10 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:30:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Flow 'volume_create_manager' (53f5b8a5-b13d-4724-9967-1a216c38be67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:30:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4dcb5a-d796-4f5f-bb66-cce2da4c4040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4dcb5a-d796-4f5f-bb66-cce2da4c4040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-776532751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffca3d99-1388-4b33-9aae-03338fbaa02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e8368106734866917d23f4f881ffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:30:11Z,use_quota=True,user_id='c4bf7a99945c4527b32878fbcb65f675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47b77e5-f83c-4ff7-818c-151a108efcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47b77e5-f83c-4ff7-818c-151a108efcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede00404-a2aa-4936-bbe1-7e4e1492dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:10 devstack cinder-volume[87313]: DEBUG cinder.image.glance [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Creating Keystone auth plugin from conf {{(pid=87313) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede00404-a2aa-4936-bbe1-7e4e1492dea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ffca3d99-1388-4b33-9aae-03338fbaa02b', 'volume_name': 'volume-ffca3d99-1388-4b33-9aae-03338fbaa02b', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21781b59-c616-4352-a528-e7c5cec31d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21781b59-c616-4352-a528-e7c5cec31d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcffea6-4a95-4d32-ae2a-86bddf991134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:11 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Volume ffca3d99-1388-4b33-9aae-03338fbaa02b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ffca3d99-1388-4b33-9aae-03338fbaa02b', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Trying to clone ffca3d99-1388-4b33-9aae-03338fbaa02b from image 923d33a7-8f5b-413a-bd44-620eb1f09c8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]). {{(pid=87313) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 02:30:11 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Image download 20.69 MB at 20.69 MB/s Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1d8bad-7714-45d4-86af-86cd355137db]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:11 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD Sep 07 02:30:11 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:11 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Temporary image 923d33a7-8f5b-413a-bd44-620eb1f09c8b is fetched for user c4bf7a99945c4527b32878fbcb65f675. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4458c8e0-ec7b-4021-9a17-54970d752e75]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:12 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD Sep 07 02:30:12 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:12 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-776532751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffca3d99-1388-4b33-9aae-03338fbaa02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e8368106734866917d23f4f881ffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:30:11Z,use_quota=True,user_id='c4bf7a99945c4527b32878fbcb65f675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Creating volume ffca3d99-1388-4b33-9aae-03338fbaa02b {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:30:12 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:12 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b 1073741824 Sep 07 02:30:12 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:12 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b 1073741824" returned: 0 in 0.397s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:12 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b Sep 07 02:30:12 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:13 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Attempting download of 923d33a7-8f5b-413a-bd44-620eb1f09c8b ((None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}])) to volume ffca3d99-1388-4b33-9aae-03338fbaa02b. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccc1e6a-054c-44d1-8e18-b70b50a9ec04]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z2s37ozc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:13 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z2s37ozc Sep 07 02:30:13 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:13 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z2s37ozc" returned: 0 in 0.319s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z2s37ozc {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:13 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z2s37ozc Sep 07 02:30:13 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:13 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z2s37ozc" returned: 1 in 0.318s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_923d33a7-8f5b-413a-bd44-620eb1f09c8b_z2s37ozc' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c5418f-fbc7-47eb-946f-bb1d4cd69982]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:13 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD Sep 07 02:30:13 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:14 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:14 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] 923d33a7-8f5b-413a-bd44-620eb1f09c8b was qcow2, converting to qcow2 {{(pid=87313) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 02:30:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:14 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b Sep 07 02:30:14 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:15 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b" returned: 0 in 1.495s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_923d33a7-8f5b-413a-bd44-620eb1f09c8b_7ekbj4v3devstack@QuobyteHD, size 112.00 MB, duration 1.50 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:30:15 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Converted 112.00 MB image at 74.86 MB/s Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:15 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b 1G Sep 07 02:30:15 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:15 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b 1G" returned: 0 in 0.311s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Downloaded image 923d33a7-8f5b-413a-bd44-620eb1f09c8b ((None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}])) to volume ffca3d99-1388-4b33-9aae-03338fbaa02b successfully. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Temporary image 923d33a7-8f5b-413a-bd44-620eb1f09c8b for user c4bf7a99945c4527b32878fbcb65f675 is deleted. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Marking volume ffca3d99-1388-4b33-9aae-03338fbaa02b as bootable. {{(pid=87313) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Copying metadata from image 923d33a7-8f5b-413a-bd44-620eb1f09c8b to ffca3d99-1388-4b33-9aae-03338fbaa02b. {{(pid=87313) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Creating volume glance metadata for volume ffca3d99-1388-4b33-9aae-03338fbaa02b backed by image 923d33a7-8f5b-413a-bd44-620eb1f09c8b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87313) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcffea6-4a95-4d32-ae2a-86bddf991134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffca3d99-1388-4b33-9aae-03338fbaa02b', 'volume_size': 1, 'image_id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5213ebb65a2041ed8324c1c4ee7dc36c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '923d33a7-8f5b-413a-bd44-620eb1f09c8b', 'created_at': datetime.datetime(2026, 9, 7, 0, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 9, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/923d33a7-8f5b-413a-bd44-620eb1f09c8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09eaf897-e7f1-41c4-bfa0-93a0f8cd12a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:15 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Volume volume-ffca3d99-1388-4b33-9aae-03338fbaa02b (ffca3d99-1388-4b33-9aae-03338fbaa02b): created successfully Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09eaf897-e7f1-41c4-bfa0-93a0f8cd12a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Flow 'volume_create_manager' (53f5b8a5-b13d-4724-9967-1a216c38be67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:30:15 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-60172115-a826-4e8e-823b-cd7066a98e04 tempest-VolumesExtendTest-767400 None] Created volume successfully. Sep 07 02:30:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4e8b356f-1727-49c5-97cf-8d3c19e87856 tempest-VolumesExtendTest-767400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4e8b356f-1727-49c5-97cf-8d3c19e87856 tempest-VolumesExtendTest-767400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:17 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[495b8da1-cff7-48ab-8dd3-f6d839be5b80]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4e8b356f-1727-49c5-97cf-8d3c19e87856 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:17 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b Sep 07 02:30:17 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:17 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4e8b356f-1727-49c5-97cf-8d3c19e87856 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b" returned: 0 in 0.347s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4e8b356f-1727-49c5-97cf-8d3c19e87856 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b 2G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4e8b356f-1727-49c5-97cf-8d3c19e87856 tempest-VolumesExtendTest-767400 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b 2G" returned: 0 in 0.086s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4e8b356f-1727-49c5-97cf-8d3c19e87856 tempest-VolumesExtendTest-767400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.451s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:17 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4e8b356f-1727-49c5-97cf-8d3c19e87856 tempest-VolumesExtendTest-767400 None] Extend volume completed successfully. Sep 07 02:30:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Acquiring lock "cinder-ffca3d99-1388-4b33-9aae-03338fbaa02b-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:30:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Lock "cinder-ffca3d99-1388-4b33-9aae-03338fbaa02b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:30:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Acquiring lock "cinder-quobyte-ffca3d99-1388-4b33-9aae-03338fbaa02b" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:30:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Lock "cinder-quobyte-ffca3d99-1388-4b33-9aae-03338fbaa02b" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:30:18 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ead5bf-da77-4395-818e-45ba00b45ed0]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:18 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b Sep 07 02:30:18 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:18 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b" returned: 0 in 0.368s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:18 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b Sep 07 02:30:18 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:19 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ffca3d99-1388-4b33-9aae-03338fbaa02b" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Lock "cinder-quobyte-ffca3d99-1388-4b33-9aae-03338fbaa02b" released by "delete_volume" :: held 0.645s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Created reservations ['c8c6dba8-7628-4449-890c-9354fb831788', 'fc52acab-3fe8-40fc-8506-940a8b0a9d82', 'f622d29a-8675-4f3c-b8b4-fd763fa944eb', '87f1b8cc-b669-4ecd-8a6b-c8b5260a3518'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:19 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:30:19 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:19 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.239s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:30:19 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Deleted volume successfully. Sep 07 02:30:19 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-10748c1e-a942-40cd-812a-04f952e083d7 tempest-VolumesExtendTest-767400 None] Lock "cinder-ffca3d99-1388-4b33-9aae-03338fbaa02b-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Flow 'volume_create_manager' (b130df40-bba7-4a6a-a95e-3120160f439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f75245-04cc-4d79-a10b-ef3744a65ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f75245-04cc-4d79-a10b-ef3744a65ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-333280492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e8368106734866917d23f4f881ffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:30:20Z,use_quota=True,user_id='c4bf7a99945c4527b32878fbcb65f675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d361bbe0-8421-40ac-a48f-ce133b5a54d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d361bbe0-8421-40ac-a48f-ce133b5a54d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead0e1da-c78c-47c8-b29e-c521f5d6e6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead0e1da-c78c-47c8-b29e-c521f5d6e6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea', 'volume_name': 'volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33df3ad3-dd7a-4469-8fd1-dd286099c569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33df3ad3-dd7a-4469-8fd1-dd286099c569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16cd84f8-69b9-40ab-af16-bcff083b73fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:20 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Volume dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea', 'volume_size': 1} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-333280492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e8368106734866917d23f4f881ffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:30:20Z,use_quota=True,user_id='c4bf7a99945c4527b32878fbcb65f675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Creating volume dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:30:20 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:20 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea 1073741824 Sep 07 02:30:20 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:20 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea 1073741824" returned: 0 in 0.397s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:20 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea Sep 07 02:30:20 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:20 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" returned: 0 in 0.256s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16cd84f8-69b9-40ab-af16-bcff083b73fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3357b37-8fb1-4cf9-a025-cf570fd5a88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:20 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Volume volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea (dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea): created successfully Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3357b37-8fb1-4cf9-a025-cf570fd5a88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Flow 'volume_create_manager' (b130df40-bba7-4a6a-a95e-3120160f439a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:30:20 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-39b5babb-5067-4a02-9f37-360ea376bca0 tempest-VolumesExtendTest-767400 None] Created volume successfully. Sep 07 02:30:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] Creating offline snapshot b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 of volume dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:30:21 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77d21e2-7d40-469d-a835-b86537adaec0]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:21 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea Sep 07 02:30:21 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:21 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" returned: 0 in 0.355s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:21 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 1G Sep 07 02:30:21 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:22 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 1G" returned: 0 in 0.379s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:22 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 Sep 07 02:30:22 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:22 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1" returned: 0 in 0.289s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:22 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 is being set with open permissions: ugo+rw Sep 07 02:30:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:22 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 Sep 07 02:30:22 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:22 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1" returned: 0 in 0.234s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:22 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.info Sep 07 02:30:22 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:22 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.info" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:22 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.info is being set with open permissions: ugo+rw Sep 07 02:30:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:22 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.info Sep 07 02:30:22 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:23 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.info" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:23 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5f40c962-f73d-493b-9c3c-9e592d878e89 tempest-VolumesExtendTest-767400 None] Create snapshot completed successfully Sep 07 02:30:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8717c6f4-c383-46e3-99b0-ae6ec915b7f4 tempest-VolumesExtendTest-767400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8717c6f4-c383-46e3-99b0-ae6ec915b7f4 tempest-VolumesExtendTest-767400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:23 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fb8802-7cd8-4918-967a-aba50a63bf18]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8717c6f4-c383-46e3-99b0-ae6ec915b7f4 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:23 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea Sep 07 02:30:23 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:23 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8717c6f4-c383-46e3-99b0-ae6ec915b7f4 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" returned: 0 in 0.349s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8717c6f4-c383-46e3-99b0-ae6ec915b7f4 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 2G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8717c6f4-c383-46e3-99b0-ae6ec915b7f4 tempest-VolumesExtendTest-767400 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 2G" returned: 0 in 0.115s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8717c6f4-c383-46e3-99b0-ae6ec915b7f4 tempest-VolumesExtendTest-767400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.493s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:23 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8717c6f4-c383-46e3-99b0-ae6ec915b7f4 tempest-VolumesExtendTest-767400 None] Extend volume completed successfully. Sep 07 02:30:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Acquiring lock "cinder-b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:30:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Lock "cinder-b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:30:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Acquiring lock "cinder-quobyte-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:30:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Lock "cinder-quobyte-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:30:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Acquiring lock "cinder-quobyte-b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:30:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Lock "cinder-quobyte-b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:30:24 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Deleting offline snapshot b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 of volume dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:30:24 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] snapshot_file for this snap is: volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:30:24 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea974e5-8f5a-4500-9ba6-2948bac9c8d5]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:24 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 Sep 07 02:30:24 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:25 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1" returned: 0 in 0.360s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:30:25 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd69f2b-e66c-488e-9352-fd0c976f0acc]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:25 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea Sep 07 02:30:25 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:25 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" returned: 0 in 0.352s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:25 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 Sep 07 02:30:25 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:25 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1" returned: 0 in 0.360s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:25 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1 Sep 07 02:30:25 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:26 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea.b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Lock "cinder-quobyte-b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1" released by "_delete_snapshot" :: held 1.412s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Lock "cinder-quobyte-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" released by "delete_snapshot" :: held 1.432s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Created reservations ['990ae9f0-871d-4253-9123-f26d661b73e6', '4b29b061-3988-4517-b4e2-0af428eba1fa', '5e07c7c0-24d5-4846-bcf6-dd9b9474bc1f', '385a49b2-7f47-4e68-9854-c8a42089f39b'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:26 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:30:26 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:26 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Delete snapshot completed successfully. Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5809d30b-0638-4206-938e-ad93c2dd5f79 tempest-VolumesExtendTest-767400 None] Lock "cinder-b5ee58f8-d3ef-4109-84ee-b8a1ffdf39d1-delete_snapshot" released by "delete_snapshot" :: held 1.581s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:30:26 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.248s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Acquiring lock "cinder-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Lock "cinder-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Acquiring lock "cinder-quobyte-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Lock "cinder-quobyte-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd03f45-0c39-4ebf-b9d0-95ebe5974255]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:27 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea Sep 07 02:30:27 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:27 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" returned: 0 in 0.355s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:27 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea Sep 07 02:30:27 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:27 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" returned: 0 in 0.250s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Lock "cinder-quobyte-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea" released by "delete_volume" :: held 0.655s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Created reservations ['7fc873e8-7d9b-4405-b9a4-0e4ba013c5dc', '44b8785d-e466-4e03-aceb-02f99cf4b3b2', '3a99191c-51fc-427f-be3c-40e1734023a7', 'e15e316d-98f4-418a-a563-413525bad84d'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:27 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:30:27 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:27 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:30:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Deleted volume successfully. Sep 07 02:30:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c704d865-3903-4b78-a40c-f7fcbd2417c2 tempest-VolumesExtendTest-767400 None] Lock "cinder-dfcb45e3-90a7-45c5-aa52-ffd21e03e6ea-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Flow 'volume_create_manager' (1c0e520f-5311-46f6-b239-382182473cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fa540b-2378-4c9a-a1d1-a5b91e5d1bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fa540b-2378-4c9a-a1d1-a5b91e5d1bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-300532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a4daef-22c8-4b6a-8458-7494452ad12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d216b06a71443ea99e57e29bbe62ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:30:34Z,use_quota=True,user_id='8346a6eb6b1d48e5af8b26bad93d5777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62ade09-48f5-4758-8db3-53580bfbf469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62ade09-48f5-4758-8db3-53580bfbf469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56956c0f-a0ca-43f2-8a1a-bf18dba72224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56956c0f-a0ca-43f2-8a1a-bf18dba72224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a4daef-22c8-4b6a-8458-7494452ad12e', 'volume_name': 'volume-61a4daef-22c8-4b6a-8458-7494452ad12e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7034955c-15fa-477b-8062-af5126e66f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7034955c-15fa-477b-8062-af5126e66f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8ccfd1-17c5-46f8-a4c9-5f8e5553bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:34 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Volume 61a4daef-22c8-4b6a-8458-7494452ad12e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a4daef-22c8-4b6a-8458-7494452ad12e', 'volume_size': 1} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-300532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a4daef-22c8-4b6a-8458-7494452ad12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d216b06a71443ea99e57e29bbe62ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:30:34Z,use_quota=True,user_id='8346a6eb6b1d48e5af8b26bad93d5777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Creating volume 61a4daef-22c8-4b6a-8458-7494452ad12e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:30:34 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:34 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e 1073741824 Sep 07 02:30:34 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:34 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e 1073741824" returned: 0 in 0.403s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:34 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e Sep 07 02:30:34 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:34 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e" returned: 0 in 0.244s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8ccfd1-17c5-46f8-a4c9-5f8e5553bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a4daef-22c8-4b6a-8458-7494452ad12e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbbc99e-c5cb-42aa-9547-8e4814ed9410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:34 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Volume volume-61a4daef-22c8-4b6a-8458-7494452ad12e (61a4daef-22c8-4b6a-8458-7494452ad12e): created successfully Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbbc99e-c5cb-42aa-9547-8e4814ed9410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Flow 'volume_create_manager' (1c0e520f-5311-46f6-b239-382182473cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:30:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-00786639-e2fd-4e4a-8f6e-39301cd20074 tempest-VolumesNegativeTest-1986663645 None] Created volume successfully. Sep 07 02:30:44 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=45,cinder:SELECT=38,cinder:INSERT=21,cinder:DELETE=2 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:30:44 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=44,cinder:INSERT=12,cinder:UPDATE=49,cinder:DELETE=5 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:30:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Acquiring lock "cinder-61a4daef-22c8-4b6a-8458-7494452ad12e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:30:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Lock "cinder-61a4daef-22c8-4b6a-8458-7494452ad12e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:30:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Acquiring lock "cinder-quobyte-61a4daef-22c8-4b6a-8458-7494452ad12e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:30:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Lock "cinder-quobyte-61a4daef-22c8-4b6a-8458-7494452ad12e" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:30:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[62114d80-2d5c-4fe7-afe8-6646002dacd8]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:50 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e Sep 07 02:30:50 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:50 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e" returned: 0 in 0.352s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:50 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e Sep 07 02:30:50 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:50 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-61a4daef-22c8-4b6a-8458-7494452ad12e" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Lock "cinder-quobyte-61a4daef-22c8-4b6a-8458-7494452ad12e" released by "delete_volume" :: held 0.638s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Created reservations ['cfbc1421-73bd-445d-a23a-d1415f75d3c6', '40c68daf-6294-418f-90da-f30f79fc622f', '03560864-1b3d-4f62-9058-b0eed0cb1598', 'd97d679f-0be4-4348-bf38-cf17dbd0f417'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:50 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:30:50 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:50 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:50 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:30:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Deleted volume successfully. Sep 07 02:30:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-75a01d2e-94c5-4b28-b2df-4f56108ab165 tempest-VolumesNegativeTest-1986663645 None] Lock "cinder-61a4daef-22c8-4b6a-8458-7494452ad12e-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:30:53 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Flow 'volume_create_manager' (63980644-8bf0-4081-8ac8-efcad6a07c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5bc341-158b-4e78-b136-5484fa15fe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5bc341-158b-4e78-b136-5484fa15fe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-147415956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff43f91-c9d6-47f4-b4c6-4563d63eaa7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3bd74bbe47847e9809c1606d1a1db41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:30:54Z,use_quota=True,user_id='6d0c3298d0714fcfbbcaa58ff7ea6a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd36684-58f6-416b-8f83-b758675c25c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd36684-58f6-416b-8f83-b758675c25c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc226b30-5535-4728-a948-d1b014bb9406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc226b30-5535-4728-a948-d1b014bb9406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff43f91-c9d6-47f4-b4c6-4563d63eaa7e', 'volume_name': 'volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14135d6-39a1-4d49-8e2e-4a3e25b77bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14135d6-39a1-4d49-8e2e-4a3e25b77bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24e3e3e-a200-4150-a57f-9184f21d279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:54 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Volume dff43f91-c9d6-47f4-b4c6-4563d63eaa7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e', 'volume_size': 1} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-147415956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff43f91-c9d6-47f4-b4c6-4563d63eaa7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3bd74bbe47847e9809c1606d1a1db41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:30:54Z,use_quota=True,user_id='6d0c3298d0714fcfbbcaa58ff7ea6a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Creating volume dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:30:54 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:54 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e 1073741824 Sep 07 02:30:54 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:54 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e 1073741824" returned: 0 in 0.405s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:54 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e Sep 07 02:30:54 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:54 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24e3e3e-a200-4150-a57f-9184f21d279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1577ea-be43-4faf-baf6-5debdb74e18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:30:54 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Volume volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e (dff43f91-c9d6-47f4-b4c6-4563d63eaa7e): created successfully Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1577ea-be43-4faf-baf6-5debdb74e18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:30:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Flow 'volume_create_manager' (63980644-8bf0-4081-8ac8-efcad6a07c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:30:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8dbd9c91-39b4-4241-b20d-9b658e094a5e tempest-VolumesSnapshotListTestJSON-1444821453 None] Created volume successfully. Sep 07 02:30:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] Creating offline snapshot 7f04b8d9-b806-4906-8670-5b9ada7bda9b of volume dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:30:55 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[746c6119-bd86-4bc9-9a0e-108c899010bc]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:55 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e Sep 07 02:30:55 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:55 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" returned: 0 in 0.346s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:55 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b 1G Sep 07 02:30:55 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:55 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b 1G" returned: 0 in 0.380s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:55 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b Sep 07 02:30:55 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:56 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b" returned: 0 in 0.287s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:56 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b is being set with open permissions: ugo+rw Sep 07 02:30:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:56 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b Sep 07 02:30:56 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:56 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:56 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.info Sep 07 02:30:56 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:56 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.info" returned: 0 in 0.241s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:56 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.info is being set with open permissions: ugo+rw Sep 07 02:30:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:56 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.info Sep 07 02:30:56 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:56 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.info" returned: 0 in 0.234s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:56 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1bcf3c27-7109-43a4-8615-6f8f1a3644c4 tempest-VolumesSnapshotListTestJSON-1444821453 None] Create snapshot completed successfully Sep 07 02:30:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] Creating offline snapshot e90348dc-6753-4f0f-aab8-8dfc1b225b2d of volume dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:30:57 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d093ba-179c-4f19-ab7b-5cefbb5a4464]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:57 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b Sep 07 02:30:57 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:57 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b" returned: 0 in 0.348s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:30:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:57 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d 1G Sep 07 02:30:57 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:58 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d 1G" returned: 0 in 0.393s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:58 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d Sep 07 02:30:58 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:58 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d" returned: 0 in 0.282s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:58 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d is being set with open permissions: ugo+rw Sep 07 02:30:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:58 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d Sep 07 02:30:58 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:30:58 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 07 02:30:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d" returned: 0 in 0.234s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:30:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.341s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:30:58 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e100239e-8ecb-4ba6-9763-bef2e1c600b9 tempest-VolumesSnapshotListTestJSON-1444821453 None] Create snapshot completed successfully Sep 07 02:30:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:30:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:30:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] Creating offline snapshot 2c21648e-5474-4009-8660-81c2cb0f25ff of volume dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:30:59 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafbaf19-cbdd-4c69-bac0-849746688e70]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:30:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:30:59 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d Sep 07 02:30:59 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:00 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d" returned: 0 in 0.351s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:31:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:00 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff 1G Sep 07 02:31:00 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:00 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff 1G" returned: 0 in 0.423s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:00 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff Sep 07 02:31:00 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:00 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff" returned: 0 in 0.286s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:00 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff is being set with open permissions: ugo+rw Sep 07 02:31:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:00 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff Sep 07 02:31:00 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:00 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.388s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:31:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1033bba6-0eeb-46c5-a1de-ffcaf9c39de8 tempest-VolumesSnapshotListTestJSON-1444821453 None] Create snapshot completed successfully Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "cinder-2c21648e-5474-4009-8660-81c2cb0f25ff-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-2c21648e-5474-4009-8660-81c2cb0f25ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "cinder-quobyte-2c21648e-5474-4009-8660-81c2cb0f25ff" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-2c21648e-5474-4009-8660-81c2cb0f25ff" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Deleting offline snapshot 2c21648e-5474-4009-8660-81c2cb0f25ff of volume dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] snapshot_file for this snap is: volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[95111382-7576-4edd-a81e-dfdf4ea751e9]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:02 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff Sep 07 02:31:02 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:02 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff" returned: 0 in 0.346s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fce3a5a-0912-4a57-bdde-af5e1aaa3676]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:31:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:03 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d Sep 07 02:31:03 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:03 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d" returned: 0 in 0.344s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:31:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:03 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff Sep 07 02:31:03 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:03 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff" returned: 0 in 0.379s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:03 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff Sep 07 02:31:03 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:03 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.2c21648e-5474-4009-8660-81c2cb0f25ff" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-2c21648e-5474-4009-8660-81c2cb0f25ff" released by "_delete_snapshot" :: held 1.390s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" released by "delete_snapshot" :: held 1.413s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Created reservations ['7fced7fa-b899-457f-b0ea-a5214794d7ba', '4192f66b-28f4-4c68-aacb-a13a3ce37c9b', 'ed954e53-a78f-45dd-836b-5bba66e5fea5', 'cceb0375-157b-4370-ae30-52da75a41b0c'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:31:04 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Delete snapshot completed successfully. Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-206177b7-fe8a-420a-a6bd-ce8f504ad347 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-2c21648e-5474-4009-8660-81c2cb0f25ff-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "cinder-e90348dc-6753-4f0f-aab8-8dfc1b225b2d-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-e90348dc-6753-4f0f-aab8-8dfc1b225b2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "cinder-quobyte-e90348dc-6753-4f0f-aab8-8dfc1b225b2d" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-e90348dc-6753-4f0f-aab8-8dfc1b225b2d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Deleting offline snapshot e90348dc-6753-4f0f-aab8-8dfc1b225b2d of volume dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] snapshot_file for this snap is: volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cc4e3d-3f37-451b-bf2e-df57f0430c70]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:31:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:04 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d Sep 07 02:31:04 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:05 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d" returned: 0 in 0.345s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:31:05 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9306b06-54a8-4bda-a334-79d3c523787d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:31:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:05 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b Sep 07 02:31:05 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:05 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b" returned: 0 in 0.341s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:31:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:05 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d Sep 07 02:31:05 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:05 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d" returned: 0 in 0.348s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:05 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d Sep 07 02:31:05 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:06 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.e90348dc-6753-4f0f-aab8-8dfc1b225b2d" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-e90348dc-6753-4f0f-aab8-8dfc1b225b2d" released by "_delete_snapshot" :: held 1.362s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" released by "delete_snapshot" :: held 1.391s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Created reservations ['d16fc5d9-6442-4ff6-a11c-fe1db98de48e', 'a64a9d64-6e71-495d-812b-27495de9ae14', 'bfe3185e-7457-4395-bb1d-05d03880b4b8', '6a52f3c1-c50c-40a3-85a7-29e56502e7a1'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:31:06 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Delete snapshot completed successfully. Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e5af6db9-f27f-4b52-b1e4-03eecf800c6c tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-e90348dc-6753-4f0f-aab8-8dfc1b225b2d-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "cinder-7f04b8d9-b806-4906-8670-5b9ada7bda9b-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-7f04b8d9-b806-4906-8670-5b9ada7bda9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "cinder-quobyte-7f04b8d9-b806-4906-8670-5b9ada7bda9b" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-7f04b8d9-b806-4906-8670-5b9ada7bda9b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Deleting offline snapshot 7f04b8d9-b806-4906-8670-5b9ada7bda9b of volume dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] snapshot_file for this snap is: volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18204b9-a1d1-4652-a799-3bdb9be78240]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:31:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:06 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b Sep 07 02:31:06 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:07 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b" returned: 0 in 0.352s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:31:07 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df9caca-ad0d-4bf6-898a-73d94993bd11]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:31:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:07 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e Sep 07 02:31:07 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:07 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" returned: 0 in 0.351s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:07 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b Sep 07 02:31:07 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:07 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b" returned: 0 in 0.335s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:07 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b Sep 07 02:31:07 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:08 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e.7f04b8d9-b806-4906-8670-5b9ada7bda9b" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-7f04b8d9-b806-4906-8670-5b9ada7bda9b" released by "_delete_snapshot" :: held 1.372s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" released by "delete_snapshot" :: held 1.392s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:08 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Created reservations ['5fe9fbce-87af-4360-9b56-6f20867f9b16', 'd1b52d28-38cd-4857-9852-0d8cd8f2d959', '1cf6a5ce-47b4-4650-b8e5-e9e3ce79b263', 'a430a8cd-57ed-489f-a513-cbed4ad37f35'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:31:08 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Delete snapshot completed successfully. Sep 07 02:31:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc818abf-be53-4f3e-acaa-42f6a70458ef tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-7f04b8d9-b806-4906-8670-5b9ada7bda9b-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "cinder-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad6b346-9570-4eaf-8991-4baab8c70fc0]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:09 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e Sep 07 02:31:09 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:09 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" returned: 0 in 0.342s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:09 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e Sep 07 02:31:09 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:09 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-quobyte-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e" released by "delete_volume" :: held 0.635s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Created reservations ['23b12bbf-66ee-40ec-ba58-f12571040c58', '8ed264c8-bfeb-426c-8f4f-ba5cada3385b', 'd5de55da-6231-4cee-bc3f-4c23e63b57ca', '51ecbb53-48c4-4cb8-8290-8c8b57649197'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:31:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:09 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:31:09 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:10 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.240s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:10 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:31:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Deleted volume successfully. Sep 07 02:31:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-eda5989e-9f9a-438a-b4b6-a32faf92e411 tempest-VolumesSnapshotListTestJSON-1444821453 None] Lock "cinder-dff43f91-c9d6-47f4-b4c6-4563d63eaa7e-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Flow 'volume_create_manager' (d626e41c-3697-45d0-b1c1-50c49ec946e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f81e2b-a67f-4422-b554-9b185e4acdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f81e2b-a67f-4422-b554-9b185e4acdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-866124578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32796a37-6c55-4ea4-b908-85235c1873c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa6c7a3d0bd4c59ae7f0e7358f3e4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:31:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:31:14Z,use_quota=True,user_id='52d3537fe96b48bcba4d048b8824ce00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e987496-6075-4171-967e-36699bd5b8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e987496-6075-4171-967e-36699bd5b8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06072128-1a3b-4b66-83ce-eb0f198400b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06072128-1a3b-4b66-83ce-eb0f198400b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32796a37-6c55-4ea4-b908-85235c1873c8', 'volume_name': 'volume-32796a37-6c55-4ea4-b908-85235c1873c8', 'volume_size': 2}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb65f95f-4624-46ff-89ee-6697109ecf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb65f95f-4624-46ff-89ee-6697109ecf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a649a8-ccba-453b-b14a-392606503fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:13 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Volume 32796a37-6c55-4ea4-b908-85235c1873c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32796a37-6c55-4ea4-b908-85235c1873c8', 'volume_size': 2} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-866124578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32796a37-6c55-4ea4-b908-85235c1873c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa6c7a3d0bd4c59ae7f0e7358f3e4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:31:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:31:14Z,use_quota=True,user_id='52d3537fe96b48bcba4d048b8824ce00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Creating volume 32796a37-6c55-4ea4-b908-85235c1873c8 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:31:13 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:31:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 2147483648 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:13 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 2147483648 Sep 07 02:31:13 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:14 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 2147483648" returned: 0 in 0.435s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:14 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 Sep 07 02:31:14 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:14 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8" returned: 0 in 0.237s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a649a8-ccba-453b-b14a-392606503fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32796a37-6c55-4ea4-b908-85235c1873c8', 'volume_size': 2}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d344158-21a5-4ac3-beea-b2e2901b3cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:14 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Volume volume-32796a37-6c55-4ea4-b908-85235c1873c8 (32796a37-6c55-4ea4-b908-85235c1873c8): created successfully Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d344158-21a5-4ac3-beea-b2e2901b3cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Flow 'volume_create_manager' (d626e41c-3697-45d0-b1c1-50c49ec946e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:31:14 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-49589116-1518-459f-8db4-b010afdf8ea1 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Created volume successfully. Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Creating offline snapshot e63cebf2-e162-4f2c-9f0f-58db87790e6f of volume 32796a37-6c55-4ea4-b908-85235c1873c8 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa0cf22-871e-4019-a037-a9bcdafc7d7e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:31:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:14 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 Sep 07 02:31:14 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:15 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8" returned: 0 in 0.348s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f 2G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:15 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f 2G Sep 07 02:31:15 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:15 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f 2G" returned: 0 in 0.373s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32796a37-6c55-4ea4-b908-85235c1873c8 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:15 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32796a37-6c55-4ea4-b908-85235c1873c8 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f Sep 07 02:31:15 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:15 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32796a37-6c55-4ea4-b908-85235c1873c8 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f" returned: 0 in 0.282s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:15 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f is being set with open permissions: ugo+rw Sep 07 02:31:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:15 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f Sep 07 02:31:15 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:16 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f" returned: 0 in 0.241s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:16 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.info Sep 07 02:31:16 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:16 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.info" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:16 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.info is being set with open permissions: ugo+rw Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:16 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.info Sep 07 02:31:16 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:16 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.info" returned: 0 in 0.248s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:31:16 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-afe75584-0951-4017-ab08-a4f0a515bdaf tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Create snapshot completed successfully Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Acquiring lock "cinder-e63cebf2-e162-4f2c-9f0f-58db87790e6f-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "cinder-e63cebf2-e162-4f2c-9f0f-58db87790e6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Acquiring lock "cinder-quobyte-32796a37-6c55-4ea4-b908-85235c1873c8" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "cinder-quobyte-32796a37-6c55-4ea4-b908-85235c1873c8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Acquiring lock "cinder-quobyte-e63cebf2-e162-4f2c-9f0f-58db87790e6f" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "cinder-quobyte-e63cebf2-e162-4f2c-9f0f-58db87790e6f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Deleting offline snapshot e63cebf2-e162-4f2c-9f0f-58db87790e6f of volume 32796a37-6c55-4ea4-b908-85235c1873c8 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:31:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] snapshot_file for this snap is: volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:31:17 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cec07d-1414-4514-b004-27d5e1abd7eb]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:31:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:17 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f Sep 07 02:31:17 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:17 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f" returned: 0 in 0.344s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32796a37-6c55-4ea4-b908-85235c1873c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:31:17 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[9808fb9c-e724-4639-b942-9b4e43f85405]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:31:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:17 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 Sep 07 02:31:17 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:17 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8" returned: 0 in 0.350s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:17 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f Sep 07 02:31:17 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:18 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f" returned: 0 in 0.327s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:18 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f Sep 07 02:31:18 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:18 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8.e63cebf2-e162-4f2c-9f0f-58db87790e6f" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "cinder-quobyte-e63cebf2-e162-4f2c-9f0f-58db87790e6f" released by "_delete_snapshot" :: held 1.363s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "cinder-quobyte-32796a37-6c55-4ea4-b908-85235c1873c8" released by "delete_snapshot" :: held 1.383s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:18 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Created reservations ['274b5346-14da-49fb-8bc4-38cbeab221a5', 'b6e9af13-0e35-4ea1-a6f4-65bc7355ae3e', 'ee1fbe57-d749-434c-bb8d-08c636c2f5f2', 'c6965b5e-fdcb-4f8c-acc5-fb23a4f686d9'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:31:18 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Delete snapshot completed successfully. Sep 07 02:31:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5db49110-176a-4609-8f9e-26ca38cb66e5 tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "cinder-e63cebf2-e162-4f2c-9f0f-58db87790e6f-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Acquiring lock "cinder-32796a37-6c55-4ea4-b908-85235c1873c8-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "cinder-32796a37-6c55-4ea4-b908-85235c1873c8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Acquiring lock "cinder-quobyte-32796a37-6c55-4ea4-b908-85235c1873c8" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "cinder-quobyte-32796a37-6c55-4ea4-b908-85235c1873c8" acquired by "delete_volume" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[9972a40e-f84a-4da6-8f27-b6ca85a5e243]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:19 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 Sep 07 02:31:19 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:19 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8" returned: 0 in 0.344s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:19 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8 Sep 07 02:31:19 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:19 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-32796a37-6c55-4ea4-b908-85235c1873c8" returned: 0 in 0.236s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "cinder-quobyte-32796a37-6c55-4ea4-b908-85235c1873c8" released by "delete_volume" :: held 0.633s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Created reservations ['65d085a8-393f-4598-bef9-e24e8698bcad', '53555829-73f5-46e0-b602-f9c03554c199', '300ef994-ddf8-4a3c-874d-6daac0d66fba', 'a8cb3c75-d3a0-477d-85f3-fe5fdbf4d178'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:31:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:19 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:31:19 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:20 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:20 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:31:20 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Deleted volume successfully. Sep 07 02:31:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67bcc46b-82c2-4848-907d-c7ba9aca201f tempest-VolumesSnapshotNegativeTestJSON-168704082 None] Lock "cinder-32796a37-6c55-4ea4-b908-85235c1873c8-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:26 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:31:26 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:26 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:31:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:31:29 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=59,cinder:SELECT=44,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:31:30 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=58,cinder:INSERT=14,cinder:UPDATE=55,cinder:DELETE=5 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Flow 'volume_create_manager' (8fe96eef-a47d-43f2-92d9-ede54dbd7f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ff2d4b-30c3-400d-b2da-42d23625bd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ff2d4b-30c3-400d-b2da-42d23625bd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-333484599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e8db39-6675-4c31-a4fe-67a9c5923ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f24aff3ffd4331becd0c6990a5d025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:31:51Z,use_quota=True,user_id='5e9cbfb055684ac4ba8380a54f443848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218e6305-2304-440d-8621-d0a4f1e4e922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218e6305-2304-440d-8621-d0a4f1e4e922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d60de7c-c05b-479e-9ac2-02c28de0a4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d60de7c-c05b-479e-9ac2-02c28de0a4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e8db39-6675-4c31-a4fe-67a9c5923ee4', 'volume_name': 'volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295285ab-5970-44dd-b765-bbd854c6ca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295285ab-5970-44dd-b765-bbd854c6ca8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d067d86-fad2-4f74-8567-b66daa6c8cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:50 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Volume e8e8db39-6675-4c31-a4fe-67a9c5923ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4', 'volume_size': 1} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-333484599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e8db39-6675-4c31-a4fe-67a9c5923ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f24aff3ffd4331becd0c6990a5d025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:31:51Z,use_quota=True,user_id='5e9cbfb055684ac4ba8380a54f443848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Creating volume e8e8db39-6675-4c31-a4fe-67a9c5923ee4 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:31:50 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:31:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:50 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4 1073741824 Sep 07 02:31:50 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:51 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4 1073741824" returned: 0 in 0.473s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:31:51 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4 Sep 07 02:31:51 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:31:51 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 07 02:31:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:31:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:31:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:31:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d067d86-fad2-4f74-8567-b66daa6c8cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c860569-950f-47b3-b445-402506167af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:31:51 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Volume volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4 (e8e8db39-6675-4c31-a4fe-67a9c5923ee4): created successfully Sep 07 02:31:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c860569-950f-47b3-b445-402506167af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:31:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Flow 'volume_create_manager' (8fe96eef-a47d-43f2-92d9-ede54dbd7f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:31:51 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-90302bf8-b0e4-4b76-b16f-8d562e2f425d tempest-TestMinimumBasicScenario-1783610816 None] Created volume successfully. Sep 07 02:31:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-2344807b-3e0d-4be9-8c8d-65826ae9dbe3 req-de7cae08-bab5-4915-9fe8-5f8c0785e60a tempest-TestMinimumBasicScenario-1783610816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:31:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-2344807b-3e0d-4be9-8c8d-65826ae9dbe3 req-de7cae08-bab5-4915-9fe8-5f8c0785e60a tempest-TestMinimumBasicScenario-1783610816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:31:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-2344807b-3e0d-4be9-8c8d-65826ae9dbe3 req-de7cae08-bab5-4915-9fe8-5f8c0785e60a tempest-TestMinimumBasicScenario-1783610816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:31:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-2344807b-3e0d-4be9-8c8d-65826ae9dbe3 req-de7cae08-bab5-4915-9fe8-5f8c0785e60a tempest-TestMinimumBasicScenario-1783610816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43e5ce9b-d0b5-4152-8a81-89a4729e99e3', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:31:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-2344807b-3e0d-4be9-8c8d-65826ae9dbe3 req-de7cae08-bab5-4915-9fe8-5f8c0785e60a tempest-TestMinimumBasicScenario-1783610816 None] attachment_update completed successfully. Sep 07 02:32:02 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=4,cinder:SELECT=6 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:32:02 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:32:26 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:32:26 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:32:26 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.261s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:32:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:32:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-b6aae23a-cf7e-4cd6-9c7c-4bef8bd4eea7 req-b18c4731-fbb0-4334-a544-fefaffdf0ef2 tempest-TestMinimumBasicScenario-1783610816 None] Terminate volume connection completed successfully. Sep 07 02:32:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-b6aae23a-cf7e-4cd6-9c7c-4bef8bd4eea7 req-b18c4731-fbb0-4334-a544-fefaffdf0ef2 tempest-TestMinimumBasicScenario-1783610816 None] Deleting attachment 43e5ce9b-d0b5-4152-8a81-89a4729e99e3. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:32:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Acquiring lock "cinder-e8e8db39-6675-4c31-a4fe-67a9c5923ee4-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:32:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Lock "cinder-e8e8db39-6675-4c31-a4fe-67a9c5923ee4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:32:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Acquiring lock "cinder-quobyte-e8e8db39-6675-4c31-a4fe-67a9c5923ee4" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:32:39 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Lock "cinder-quobyte-e8e8db39-6675-4c31-a4fe-67a9c5923ee4" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:32:39 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[46352d5d-6dc2-46db-b8c0-e926153a6fd6]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:32:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:32:39 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4 Sep 07 02:32:39 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:32:39 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Sep 07 02:32:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4" returned: 0 in 0.356s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:32:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:32:39 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4 Sep 07 02:32:39 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:32:40 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e8e8db39-6675-4c31-a4fe-67a9c5923ee4" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Lock "cinder-quobyte-e8e8db39-6675-4c31-a4fe-67a9c5923ee4" released by "delete_volume" :: held 0.629s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Created reservations ['7e4616c3-709a-4638-88e7-7b6d8371c69b', 'f1526f00-17ab-4818-aa78-230ee2dc4625', '5a242d1f-93b4-4977-b16d-5d3756115493', 'd05c5b12-72e2-4a64-938a-999930820997'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:32:40 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:32:40 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:32:40 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.239s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:32:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Deleted volume successfully. Sep 07 02:32:40 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-82c0a1d6-c78a-40b4-9e57-cc3dc27c6d1f tempest-TestMinimumBasicScenario-1783610816 None] Lock "cinder-e8e8db39-6675-4c31-a4fe-67a9c5923ee4-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:32:50 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=10 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:32:50 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:33:26 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:33:26 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:33:26 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.248s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:33:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Flow 'volume_create_manager' (dfb65ad3-36fe-4b92-a5d9-f340c079580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e805e9-930b-4820-8967-6241223297c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e805e9-930b-4820-8967-6241223297c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1115598655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1b80c7-9910-465b-9ffe-d1c87a7e24c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a128593853f442b68eb8a5d3af519d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:33:44Z,use_quota=True,user_id='57e51cc879134b6d9c911127dde7d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039a68f8-a177-4f3b-a2ee-7a053fcd3f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039a68f8-a177-4f3b-a2ee-7a053fcd3f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2231334a-dc75-4def-b8ad-2bfadbf4eb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2231334a-dc75-4def-b8ad-2bfadbf4eb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe1b80c7-9910-465b-9ffe-d1c87a7e24c5', 'volume_name': 'volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442d217f-a1c2-44a4-9ccd-9c0fd2cab251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442d217f-a1c2-44a4-9ccd-9c0fd2cab251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a737ad7-86e5-4f9f-b063-998e850ffe53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:33:44 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Volume fe1b80c7-9910-465b-9ffe-d1c87a7e24c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5', 'volume_size': 1} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1115598655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1b80c7-9910-465b-9ffe-d1c87a7e24c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a128593853f442b68eb8a5d3af519d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:33:44Z,use_quota=True,user_id='57e51cc879134b6d9c911127dde7d2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Creating volume fe1b80c7-9910-465b-9ffe-d1c87a7e24c5 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:33:44 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:33:44 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5 1073741824 Sep 07 02:33:44 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:33:44 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5 1073741824" returned: 0 in 0.423s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:33:44 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5 Sep 07 02:33:44 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:33:44 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5" returned: 0 in 0.251s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a737ad7-86e5-4f9f-b063-998e850ffe53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c88967-47f3-4ebb-af54-3f20d067df35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:33:44 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Volume volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5 (fe1b80c7-9910-465b-9ffe-d1c87a7e24c5): created successfully Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c88967-47f3-4ebb-af54-3f20d067df35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:33:44 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Flow 'volume_create_manager' (dfb65ad3-36fe-4b92-a5d9-f340c079580c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:33:44 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f3775718-e4b2-48cb-9b1c-41fdb184cd0c tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Created volume successfully. Sep 07 02:33:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-ac330776-acae-4515-9bfd-e0ae18a05bdd req-c1a89b6f-37ea-43d9-be7d-031ebfbbec51 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:33:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-ac330776-acae-4515-9bfd-e0ae18a05bdd req-c1a89b6f-37ea-43d9-be7d-031ebfbbec51 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:33:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [req-ac330776-acae-4515-9bfd-e0ae18a05bdd req-c1a89b6f-37ea-43d9-be7d-031ebfbbec51 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:33:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-ac330776-acae-4515-9bfd-e0ae18a05bdd req-c1a89b6f-37ea-43d9-be7d-031ebfbbec51 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535', 'name': 'volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91372e1c-5ae0-43ff-bd77-8d235da86f79', 'enforce_multipath': True} {{(pid=87313) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 02:33:45 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-ac330776-acae-4515-9bfd-e0ae18a05bdd req-c1a89b6f-37ea-43d9-be7d-031ebfbbec51 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] attachment_update completed successfully. Sep 07 02:33:47 devstack cinder-volume[87313]: INFO cinder.volume.manager [req-098de76f-ab47-4b08-b86a-7f57dbe186bb req-c82841ee-ca2d-4f8a-8d10-8c4abd323acd tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Terminate volume connection completed successfully. Sep 07 02:33:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [req-098de76f-ab47-4b08-b86a-7f57dbe186bb req-c82841ee-ca2d-4f8a-8d10-8c4abd323acd tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Deleting attachment 91372e1c-5ae0-43ff-bd77-8d235da86f79. {{(pid=87313) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 02:33:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Acquiring lock "cinder-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:33:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "cinder-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:33:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Acquiring lock "cinder-quobyte-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:33:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "cinder-quobyte-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:33:48 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db110b4-2074-406a-a755-15babaf4e009]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:33:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:33:48 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5 Sep 07 02:33:48 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:33:48 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 07 02:33:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5" returned: 0 in 0.349s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:33:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:33:48 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5 Sep 07 02:33:48 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:33:49 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "cinder-quobyte-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5" released by "delete_volume" :: held 0.628s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Created reservations ['c67c47a4-e4f0-4d75-8d4c-b6a2f898545e', '56b51bdb-1a4b-43ee-9a98-f56811f0b9c5', '0316f27f-3c62-4580-a3e5-83f33af82d34', '926cb366-eaec-475a-8f75-d2def84f887e'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:33:49 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:33:49 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:33:49 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.236s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:33:49 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Deleted volume successfully. Sep 07 02:33:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d38bb2bf-17c6-423d-8251-458e28559c81 tempest-TestServerVolumeAttachScenarioOldVersion-1064636809 None] Lock "cinder-fe1b80c7-9910-465b-9ffe-d1c87a7e24c5-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:33:59 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=15,cinder:SELECT=17,cinder:INSERT=1 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:33:59 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Flow 'volume_create_manager' (04be8895-7667-4567-82be-b1ffdb3cb5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ceaa80-493e-4fc2-98c3-a19ae8af9675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ceaa80-493e-4fc2-98c3-a19ae8af9675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2053774634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb09615-021a-416f-9ff2-450fe2e80025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87161294367c4c8db50a903303190610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:34:23Z,use_quota=True,user_id='fcd5bd9ece894b5e8e289776eaacbdc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03823377-c403-47cb-952b-37b58fec79cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03823377-c403-47cb-952b-37b58fec79cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c608d6cc-d955-4810-8685-dfb938c59d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c608d6cc-d955-4810-8685-dfb938c59d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb09615-021a-416f-9ff2-450fe2e80025', 'volume_name': 'volume-ccb09615-021a-416f-9ff2-450fe2e80025', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c997b477-fef9-4793-b1fc-fc573437413a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c997b477-fef9-4793-b1fc-fc573437413a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fadf5e0-00d3-40d3-9f5f-3154051a7b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:34:23 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Volume ccb09615-021a-416f-9ff2-450fe2e80025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb09615-021a-416f-9ff2-450fe2e80025', 'volume_size': 1} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2053774634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb09615-021a-416f-9ff2-450fe2e80025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87161294367c4c8db50a903303190610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:34:23Z,use_quota=True,user_id='fcd5bd9ece894b5e8e289776eaacbdc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Creating volume ccb09615-021a-416f-9ff2-450fe2e80025 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:34:23 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:34:23 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 1073741824 Sep 07 02:34:23 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:34:23 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 1073741824" returned: 0 in 0.401s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:34:23 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 Sep 07 02:34:23 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:34:23 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025" returned: 0 in 0.241s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fadf5e0-00d3-40d3-9f5f-3154051a7b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb09615-021a-416f-9ff2-450fe2e80025', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec32f540-8f48-42c2-9973-7873aeb1461d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:34:23 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Volume volume-ccb09615-021a-416f-9ff2-450fe2e80025 (ccb09615-021a-416f-9ff2-450fe2e80025): created successfully Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec32f540-8f48-42c2-9973-7873aeb1461d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:34:23 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Flow 'volume_create_manager' (04be8895-7667-4567-82be-b1ffdb3cb5d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:34:23 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9384fd2b-b100-4cf4-9550-186105476889 tempest-TestImageHashVerification-1875864750 None] Created volume successfully. Sep 07 02:34:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:34:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:34:24 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ed2370-aeb8-43e8-9ca0-85ac687c3e04]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:34:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:34:24 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 Sep 07 02:34:24 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:34:25 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 07 02:34:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025" returned: 0 in 0.361s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:34:25 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ca5acb-d0f1-4e1d-b637-e5320787fda9]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:34:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:34:25 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 Sep 07 02:34:25 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:34:25 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Sep 07 02:34:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025" returned: 0 in 0.350s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:34:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 /opt/stack/data/cinder/conversion/ccb09615-021a-416f-9ff2-450fe2e80025.temp_image.8929e66e-b09e-4f1a-ae32-f0193470e64c8lltd425.img {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:34:25 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 /opt/stack/data/cinder/conversion/ccb09615-021a-416f-9ff2-450fe2e80025.temp_image.8929e66e-b09e-4f1a-ae32-f0193470e64c8lltd425.img Sep 07 02:34:25 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:34:26 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:34:26 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:34:26 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.506s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:34:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:34:29 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 07 02:34:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 /opt/stack/data/cinder/conversion/ccb09615-021a-416f-9ff2-450fe2e80025.temp_image.8929e66e-b09e-4f1a-ae32-f0193470e64c8lltd425.img" returned: 0 in 3.954s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:34:29 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e638b0-ed71-41bf-9d15-c8c3b0ef6768]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:34:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:34:29 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 Sep 07 02:34:29 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:34:30 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Sep 07 02:34:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025" returned: 0 in 0.519s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:34:30 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025, size 1024.00 MB, duration 3.95 sec, destination /opt/stack/data/cinder/conversion/ccb09615-021a-416f-9ff2-450fe2e80025.temp_image.8929e66e-b09e-4f1a-ae32-f0193470e64c8lltd425.img {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:34:30 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] Converted 1024.00 MB image at 258.93 MB/s Sep 07 02:34:30 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] 8929e66e-b09e-4f1a-ae32-f0193470e64c was raw, no need to convert to raw {{(pid=87313) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 02:34:33 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:34:40 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:34:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.783s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:34:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] Uploaded volume to glance image-id: 8929e66e-b09e-4f1a-ae32-f0193470e64c. {{(pid=87313) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 02:34:48 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6720e0b7-9a35-42a7-9198-ec6f7543d43f tempest-TestImageHashVerification-1875864750 None] Copy volume to image completed successfully. Sep 07 02:34:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Acquiring lock "cinder-ccb09615-021a-416f-9ff2-450fe2e80025-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:34:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Lock "cinder-ccb09615-021a-416f-9ff2-450fe2e80025-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:34:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Acquiring lock "cinder-quobyte-ccb09615-021a-416f-9ff2-450fe2e80025" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:34:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Lock "cinder-quobyte-ccb09615-021a-416f-9ff2-450fe2e80025" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:34:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde551a1-2b4a-42ff-abc8-af338ea65f94]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:34:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:34:49 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 Sep 07 02:34:49 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:34:49 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 07 02:34:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025" returned: 0 in 0.359s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:34:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:34:49 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025 Sep 07 02:34:49 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:34:49 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Sep 07 02:34:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ccb09615-021a-416f-9ff2-450fe2e80025" returned: 0 in 0.239s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:34:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Lock "cinder-quobyte-ccb09615-021a-416f-9ff2-450fe2e80025" released by "delete_volume" :: held 0.637s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:34:49 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Created reservations ['644ba57d-0088-409d-a314-208ec601f2f6', 'adc49add-ac22-4b1d-a401-498c3903bce2', '25cb68af-6edc-4544-9a3c-77c1db2dbb5e', '8ecb48cd-2e54-4c60-8544-beadab655698'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:34:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:34:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:34:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:34:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:34:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:34:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:34:50 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:34:50 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:34:50 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 07 02:34:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:34:50 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:34:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Deleted volume successfully. Sep 07 02:34:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f34a6c14-a471-4701-ae49-b5967b722557 tempest-TestImageHashVerification-1875864750 None] Lock "cinder-ccb09615-021a-416f-9ff2-450fe2e80025-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=7,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (29826882-34a5-4e3d-8295-3c0dc30d8603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0dafa63-804f-42ea-96cc-7065cd91ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0dafa63-804f-42ea-96cc-7065cd91ec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1039464789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a274b12-a863-4fda-92e5-50071b0b755d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:01Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e182145-90d8-4f3a-9d55-825495e186a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e182145-90d8-4f3a-9d55-825495e186a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0a8db1-3ed8-40e8-9373-9625a1e73ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0a8db1-3ed8-40e8-9373-9625a1e73ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a274b12-a863-4fda-92e5-50071b0b755d', 'volume_name': 'volume-7a274b12-a863-4fda-92e5-50071b0b755d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaec817f-3e9f-4005-a65b-0b7eeb118a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaec817f-3e9f-4005-a65b-0b7eeb118a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df58eefb-0a7e-4d31-8f2e-29279b17b6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:00 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume 7a274b12-a863-4fda-92e5-50071b0b755d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a274b12-a863-4fda-92e5-50071b0b755d', 'volume_size': 1} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1039464789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a274b12-a863-4fda-92e5-50071b0b755d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:01Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Creating volume 7a274b12-a863-4fda-92e5-50071b0b755d {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:00 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:00 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d 1073741824 Sep 07 02:35:00 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:01 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d 1073741824" returned: 0 in 0.403s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:01 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d Sep 07 02:35:01 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:01 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df58eefb-0a7e-4d31-8f2e-29279b17b6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a274b12-a863-4fda-92e5-50071b0b755d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8868f68-31c8-4fb9-83d0-648791da8eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:01 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume volume-7a274b12-a863-4fda-92e5-50071b0b755d (7a274b12-a863-4fda-92e5-50071b0b755d): created successfully Sep 07 02:35:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8868f68-31c8-4fb9-83d0-648791da8eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (29826882-34a5-4e3d-8295-3c0dc30d8603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d3a2c01c-0c53-4515-aac3-234e6a001201 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created volume successfully. Sep 07 02:35:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Creating offline snapshot fecccfbe-147c-40c9-aaac-5303dd63919b of volume 7a274b12-a863-4fda-92e5-50071b0b755d {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:35:02 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c9075c-3f38-4968-a538-03bc500b21ec]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:02 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d Sep 07 02:35:02 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:02 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d" returned: 0 in 0.356s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:02 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b 1G Sep 07 02:35:02 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:02 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b 1G" returned: 0 in 0.389s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a274b12-a863-4fda-92e5-50071b0b755d -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:02 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a274b12-a863-4fda-92e5-50071b0b755d -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b Sep 07 02:35:02 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:03 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a274b12-a863-4fda-92e5-50071b0b755d -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b" returned: 0 in 0.282s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:03 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b is being set with open permissions: ugo+rw Sep 07 02:35:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:03 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b Sep 07 02:35:03 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:03 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b" returned: 0 in 0.252s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:03 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.info Sep 07 02:35:03 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:03 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.info" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:03 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.info is being set with open permissions: ugo+rw Sep 07 02:35:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:03 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.info Sep 07 02:35:03 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:03 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.info" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:03 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6f1cb23e-1b65-46df-93f0-1a1d30d6a0e3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Create snapshot completed successfully Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (cf35e7be-f2c7-4b95-ac92-7279e818b250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8b9105-eaff-43bb-970c-2f85160a7545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8b9105-eaff-43bb-970c-2f85160a7545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645154813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a391ffd3-1958-4d28-9915-f7868ab264b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:05Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce7ad40-d21a-4420-a506-01758bfbdf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce7ad40-d21a-4420-a506-01758bfbdf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3aaea64-c267-496d-bba4-25c3a887909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3aaea64-c267-496d-bba4-25c3a887909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a391ffd3-1958-4d28-9915-f7868ab264b2', 'volume_name': 'volume-a391ffd3-1958-4d28-9915-f7868ab264b2', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e938ad5-8bd0-448e-adea-3a2dfdb3a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e938ad5-8bd0-448e-adea-3a2dfdb3a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e364ca7c-208f-4b60-b149-92d20855e77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:04 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume a391ffd3-1958-4d28-9915-f7868ab264b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a391ffd3-1958-4d28-9915-f7868ab264b2', 'volume_size': 1} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645154813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a391ffd3-1958-4d28-9915-f7868ab264b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:05Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Creating volume a391ffd3-1958-4d28-9915-f7868ab264b2 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:04 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:04 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2 1073741824 Sep 07 02:35:04 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (f77d3407-7145-4df4-9632-9ac16e764129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87965cde-559e-4576-9556-90bc54da79b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:04 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87965cde-559e-4576-9556-90bc54da79b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-42193512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097bd2f8-5b88-47cd-bb07-0e7e2e69565b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:05Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab75a10-4a0f-4845-a115-5ff3ca86307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab75a10-4a0f-4845-a115-5ff3ca86307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d87508f-5538-4833-9c76-98f8f2aa4209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d87508f-5538-4833-9c76-98f8f2aa4209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097bd2f8-5b88-47cd-bb07-0e7e2e69565b', 'volume_name': 'volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3445c3b2-8a33-4d18-8ec7-f3ef12bf6084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3445c3b2-8a33-4d18-8ec7-f3ef12bf6084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5cd623-97d0-4dbd-ac25-1f450221851d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume 097bd2f8-5b88-47cd-bb07-0e7e2e69565b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b', 'volume_size': 1} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:05 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2 1073741824" returned: 0 in 0.543s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:05 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2 Sep 07 02:35:05 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (e8762549-9a32-48c6-9fb8-a3bf957d0ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8b7cb7-c687-40bb-81ab-c289a5806e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8b7cb7-c687-40bb-81ab-c289a5806e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1110131130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a6fbae-0082-4951-bf0e-753c93139558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:05Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde09697-2b83-4e9e-87bb-32fa9f4b06f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde09697-2b83-4e9e-87bb-32fa9f4b06f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0cf285-81ec-4260-96a8-54244ed5f07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0cf285-81ec-4260-96a8-54244ed5f07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a6fbae-0082-4951-bf0e-753c93139558', 'volume_name': 'volume-b9a6fbae-0082-4951-bf0e-753c93139558', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc9a57e-487c-4ef1-8cc5-c82246c901dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc9a57e-487c-4ef1-8cc5-c82246c901dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee266483-87d7-4e30-9579-404b52719eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume b9a6fbae-0082-4951-bf0e-753c93139558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a6fbae-0082-4951-bf0e-753c93139558', 'volume_size': 1} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:05 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2" returned: 0 in 0.294s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.510s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-42193512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097bd2f8-5b88-47cd-bb07-0e7e2e69565b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:05Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Creating volume 097bd2f8-5b88-47cd-bb07-0e7e2e69565b {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:05 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e364ca7c-208f-4b60-b149-92d20855e77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a391ffd3-1958-4d28-9915-f7868ab264b2', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b 1073741824 Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45328e5a-70bc-46e5-84e7-1d7dd1e7a33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:05 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume volume-a391ffd3-1958-4d28-9915-f7868ab264b2 (a391ffd3-1958-4d28-9915-f7868ab264b2): created successfully Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45328e5a-70bc-46e5-84e7-1d7dd1e7a33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (cf35e7be-f2c7-4b95-ac92-7279e818b250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f70fa967-a581-454d-9fd6-26571dc0dd72 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created volume successfully. Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (33e70791-cc19-408e-a8f0-d37d51593245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3918cf3-5477-450b-9964-c69522ddc44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3918cf3-5477-450b-9964-c69522ddc44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161619867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc9967e-144e-4490-a71e-a4f4a998b940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:06Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949152ee-9074-49b0-b06b-1022964a591c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949152ee-9074-49b0-b06b-1022964a591c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eafef84-2c44-40f8-9aa0-510554e39d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eafef84-2c44-40f8-9aa0-510554e39d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc9967e-144e-4490-a71e-a4f4a998b940', 'volume_name': 'volume-adc9967e-144e-4490-a71e-a4f4a998b940', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dbba55-8d1b-4a42-98f8-e0f1b392dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dbba55-8d1b-4a42-98f8-e0f1b392dcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d71f41-e0f0-46f3-a75f-ec5bfa6a15d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:05 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume adc9967e-144e-4490-a71e-a4f4a998b940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc9967e-144e-4490-a71e-a4f4a998b940', 'volume_size': 1} Sep 07 02:35:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (5c8a7f50-b4f6-4991-a385-08f1a68a9f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2c82f9-eaa7-42e5-9814-f66ba6685be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2c82f9-eaa7-42e5-9814-f66ba6685be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1633020581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a0747e-adcc-4110-b1ba-e73e715a3b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:06Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:06 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e497cfdf-e16f-4f8c-93bc-bb0e7361690b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e497cfdf-e16f-4f8c-93bc-bb0e7361690b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e871eb3d-d237-4d94-91d9-d410421cb4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e871eb3d-d237-4d94-91d9-d410421cb4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a0747e-adcc-4110-b1ba-e73e715a3b30', 'volume_name': 'volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fb69c5-3adc-4b8d-a0ac-cfc750d4dbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fb69c5-3adc-4b8d-a0ac-cfc750d4dbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb3cc7c-02e5-4582-a7d6-189293020a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:06 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume d6a0747e-adcc-4110-b1ba-e73e715a3b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30', 'volume_size': 1} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b 1073741824" returned: 0 in 0.542s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:06 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b Sep 07 02:35:06 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:06 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b" returned: 0 in 0.254s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.979s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1110131130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a6fbae-0082-4951-bf0e-753c93139558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:05Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Creating volume b9a6fbae-0082-4951-bf0e-753c93139558 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:06 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5cd623-97d0-4dbd-ac25-1f450221851d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:06 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558 1073741824 Sep 07 02:35:06 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d283a0-5a2a-4799-8794-65875ad2a7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:06 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b (097bd2f8-5b88-47cd-bb07-0e7e2e69565b): created successfully Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d283a0-5a2a-4799-8794-65875ad2a7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (f77d3407-7145-4df4-9632-9ac16e764129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:06 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8516faea-c87b-4018-ae2e-4047863901ad tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created volume successfully. Sep 07 02:35:06 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558 1073741824" returned: 0 in 0.415s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:06 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558 Sep 07 02:35:06 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:07 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558" returned: 0 in 0.251s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161619867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc9967e-144e-4490-a71e-a4f4a998b940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:06Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Creating volume adc9967e-144e-4490-a71e-a4f4a998b940 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:07 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee266483-87d7-4e30-9579-404b52719eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a6fbae-0082-4951-bf0e-753c93139558', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8855110e-8e11-40bc-97ca-76e58130f82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:07 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940 1073741824 Sep 07 02:35:07 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:07 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume volume-b9a6fbae-0082-4951-bf0e-753c93139558 (b9a6fbae-0082-4951-bf0e-753c93139558): created successfully Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8855110e-8e11-40bc-97ca-76e58130f82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (e8762549-9a32-48c6-9fb8-a3bf957d0ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:07 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5c45a210-4ba4-4ce8-b1e7-fc816136c04e tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created volume successfully. Sep 07 02:35:07 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940 1073741824" returned: 0 in 0.415s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:07 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940 Sep 07 02:35:07 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:07 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1633020581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a0747e-adcc-4110-b1ba-e73e715a3b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fbd6fdef6db459ebb6aea228b83ded3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:06Z,use_quota=True,user_id='5751cd731ecb49319131be86ce5960ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Creating volume d6a0747e-adcc-4110-b1ba-e73e715a3b30 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:07 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d71f41-e0f0-46f3-a75f-ec5bfa6a15d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc9967e-144e-4490-a71e-a4f4a998b940', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:07 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30 1073741824 Sep 07 02:35:07 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe44224-8048-417c-92db-5bdc35a63fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:07 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume volume-adc9967e-144e-4490-a71e-a4f4a998b940 (adc9967e-144e-4490-a71e-a4f4a998b940): created successfully Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe44224-8048-417c-92db-5bdc35a63fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (33e70791-cc19-408e-a8f0-d37d51593245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:07 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a3b2735b-22a2-4de2-b3ca-b06b4658081d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created volume successfully. Sep 07 02:35:08 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30 1073741824" returned: 0 in 0.431s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:08 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30 Sep 07 02:35:08 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:08 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30" returned: 0 in 0.248s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb3cc7c-02e5-4582-a7d6-189293020a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e3eb19-d87b-44e6-9c79-918a2e92ab7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:08 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Volume volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30 (d6a0747e-adcc-4110-b1ba-e73e715a3b30): created successfully Sep 07 02:35:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e3eb19-d87b-44e6-9c79-918a2e92ab7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Flow 'volume_create_manager' (5c8a7f50-b4f6-4991-a385-08f1a68a9f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:08 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-436e9fe5-ae74-406d-8c75-1fd2db12cdb3 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created volume successfully. Sep 07 02:35:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-d6a0747e-adcc-4110-b1ba-e73e715a3b30-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-d6a0747e-adcc-4110-b1ba-e73e715a3b30-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-quobyte-d6a0747e-adcc-4110-b1ba-e73e715a3b30" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-d6a0747e-adcc-4110-b1ba-e73e715a3b30" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:09 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4966fc-a101-4bfa-b64f-892e32c119e3]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:09 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30 Sep 07 02:35:09 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:09 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30" returned: 0 in 0.356s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:09 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30 Sep 07 02:35:09 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:10 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d6a0747e-adcc-4110-b1ba-e73e715a3b30" returned: 0 in 0.244s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-d6a0747e-adcc-4110-b1ba-e73e715a3b30" released by "delete_volume" :: held 0.639s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created reservations ['0e69486c-974b-4675-824d-cb2be62513ae', 'cacbb344-1bcf-45e5-be17-734aae8ff7b7', 'c03113b6-a115-4786-a141-3322817b06b0', '042f3b2a-31b5-486d-b81a-2b0d64787603'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:10 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:10 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:10 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Deleted volume successfully. Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e0ddeab2-a7be-4b48-912e-375363b3851d tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-d6a0747e-adcc-4110-b1ba-e73e715a3b30-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-adc9967e-144e-4490-a71e-a4f4a998b940-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-adc9967e-144e-4490-a71e-a4f4a998b940-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-quobyte-adc9967e-144e-4490-a71e-a4f4a998b940" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-adc9967e-144e-4490-a71e-a4f4a998b940" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[075de23c-8c39-4d61-8c96-d53a83101991]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:10 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940 Sep 07 02:35:10 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:10 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940" returned: 0 in 0.353s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:10 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940 Sep 07 02:35:10 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:11 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-adc9967e-144e-4490-a71e-a4f4a998b940" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-adc9967e-144e-4490-a71e-a4f4a998b940" released by "delete_volume" :: held 0.635s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created reservations ['12fd45f9-bc70-46ca-8883-657e2fbef845', '48d44289-62e8-4dc8-bcf5-6e722902fcd0', 'fceff84a-2ba2-4224-8757-9a60391a60e7', '716045d6-f432-45d7-8239-33b95e4a52a2'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:11 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:11 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:11 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.244s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:11 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Deleted volume successfully. Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9a132473-a181-455c-a9cd-5005b27d1ed9 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-adc9967e-144e-4490-a71e-a4f4a998b940-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-b9a6fbae-0082-4951-bf0e-753c93139558-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-b9a6fbae-0082-4951-bf0e-753c93139558-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-quobyte-b9a6fbae-0082-4951-bf0e-753c93139558" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-b9a6fbae-0082-4951-bf0e-753c93139558" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b7e73-6ca2-420e-a761-7cf275f76dcd]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:11 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558 Sep 07 02:35:11 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:12 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558" returned: 0 in 0.356s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:12 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558 Sep 07 02:35:12 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:12 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b9a6fbae-0082-4951-bf0e-753c93139558" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-b9a6fbae-0082-4951-bf0e-753c93139558" released by "delete_volume" :: held 0.639s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created reservations ['58e913cf-83d9-4188-b52a-1591d6727425', '9f3aa741-067d-451f-99fa-851eb7d48494', 'dc06abe7-afcb-4e2d-8343-17265f0ba983', '383ec1a9-c24b-49dc-9a5e-3ab263b0c4c8'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:12 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:12 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:12 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.278s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:12 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Deleted volume successfully. Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a70000b5-115a-4820-bf84-dd2d636bed54 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-b9a6fbae-0082-4951-bf0e-753c93139558-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-097bd2f8-5b88-47cd-bb07-0e7e2e69565b-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-097bd2f8-5b88-47cd-bb07-0e7e2e69565b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-quobyte-097bd2f8-5b88-47cd-bb07-0e7e2e69565b" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-097bd2f8-5b88-47cd-bb07-0e7e2e69565b" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bc5427-7dde-45ec-b55e-08e1286eb089]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:13 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b Sep 07 02:35:13 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:13 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b" returned: 0 in 0.354s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:13 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b Sep 07 02:35:13 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:13 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-097bd2f8-5b88-47cd-bb07-0e7e2e69565b" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-097bd2f8-5b88-47cd-bb07-0e7e2e69565b" released by "delete_volume" :: held 0.634s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created reservations ['1af5763e-a238-4954-9946-a3535fc3efac', '9a8bd9ed-0a28-4527-b1d3-2b3a80e202ae', '85de3731-2899-440f-9014-ad57db30b656', '362c390d-7ef9-4580-98ca-2f757c44183e'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:13 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:13 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:13 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Deleted volume successfully. Sep 07 02:35:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a11e1105-06a6-42d3-8a54-048e5ec2aa4b tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-097bd2f8-5b88-47cd-bb07-0e7e2e69565b-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-a391ffd3-1958-4d28-9915-f7868ab264b2-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-a391ffd3-1958-4d28-9915-f7868ab264b2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-quobyte-a391ffd3-1958-4d28-9915-f7868ab264b2" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-a391ffd3-1958-4d28-9915-f7868ab264b2" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc65820-e913-4834-984b-51d7f0432685]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:14 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2 Sep 07 02:35:14 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:14 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2" returned: 0 in 0.360s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:14 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2 Sep 07 02:35:14 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:14 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a391ffd3-1958-4d28-9915-f7868ab264b2" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-a391ffd3-1958-4d28-9915-f7868ab264b2" released by "delete_volume" :: held 0.646s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created reservations ['e541ef9c-54b3-4508-9710-7ac801bc7248', 'b6374354-27e6-4cef-9bcb-b21f348a0c07', 'ee34b529-dae7-4dec-93e9-05f2c9793512', '1baa3d45-14ba-42ff-aa78-59c2de41acd2'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:14 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:14 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:15 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:15 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Deleted volume successfully. Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-54104688-0117-414a-9fcf-a6348c2a552c tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-a391ffd3-1958-4d28-9915-f7868ab264b2-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-fecccfbe-147c-40c9-aaac-5303dd63919b-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-fecccfbe-147c-40c9-aaac-5303dd63919b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-quobyte-7a274b12-a863-4fda-92e5-50071b0b755d" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-7a274b12-a863-4fda-92e5-50071b0b755d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-quobyte-fecccfbe-147c-40c9-aaac-5303dd63919b" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-fecccfbe-147c-40c9-aaac-5303dd63919b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Deleting offline snapshot fecccfbe-147c-40c9-aaac-5303dd63919b of volume 7a274b12-a863-4fda-92e5-50071b0b755d {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] snapshot_file for this snap is: volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffad5023-12d5-439c-95f3-6223f8d10439]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:15 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b Sep 07 02:35:15 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:15 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b" returned: 0 in 0.353s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a274b12-a863-4fda-92e5-50071b0b755d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff11dff-f7fe-45df-bd43-09f656a3eed2]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:15 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d Sep 07 02:35:15 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:15 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d" returned: 0 in 0.355s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:16 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b Sep 07 02:35:16 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:16 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b" returned: 0 in 0.332s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:16 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b Sep 07 02:35:16 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:16 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d.fecccfbe-147c-40c9-aaac-5303dd63919b" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-fecccfbe-147c-40c9-aaac-5303dd63919b" released by "_delete_snapshot" :: held 1.372s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-7a274b12-a863-4fda-92e5-50071b0b755d" released by "delete_snapshot" :: held 1.392s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:16 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created reservations ['277a5f45-9360-4f80-b885-d307ac50d82b', '4c441c3d-4c1d-4558-97fc-a86116c0a06a', 'c5d2759a-eaad-44fb-9378-42433a597c77', '563ebd57-f576-431f-86e4-20d6e987d9ac'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:16 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Delete snapshot completed successfully. Sep 07 02:35:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-648a580e-2884-4146-93a9-d6614e1c3992 tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-fecccfbe-147c-40c9-aaac-5303dd63919b-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-7a274b12-a863-4fda-92e5-50071b0b755d-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-7a274b12-a863-4fda-92e5-50071b0b755d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "cinder-quobyte-7a274b12-a863-4fda-92e5-50071b0b755d" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-7a274b12-a863-4fda-92e5-50071b0b755d" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:17 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a940630b-66fb-41ad-9b2c-3831ab04193d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:17 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d Sep 07 02:35:17 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:17 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d" returned: 0 in 0.349s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:17 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d Sep 07 02:35:17 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:18 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-7a274b12-a863-4fda-92e5-50071b0b755d" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-quobyte-7a274b12-a863-4fda-92e5-50071b0b755d" released by "delete_volume" :: held 0.647s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Created reservations ['d9569175-b7fb-4cc5-b6c4-e715c6962f68', '7dee21c2-4fd6-4757-b9d6-002a577a7ac5', '50686596-8d9e-4b31-a266-4dba580dc3fc', 'ee2a6c4d-828f-4982-a10a-fcdff9e740f4'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:18 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:18 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:18 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:18 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Deleted volume successfully. Sep 07 02:35:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-04090a49-7f57-47a1-a3e7-8046b173a6bf tempest-CreateVolumesFromSnapshotTest-1522161391 None] Lock "cinder-7a274b12-a863-4fda-92e5-50071b0b755d-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Flow 'volume_create_manager' (b482d489-6420-48e8-835d-c6d2ff961b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d95a6a-f127-46d4-a882-af5ca5542d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d95a6a-f127-46d4-a882-af5ca5542d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1036209065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1283719-f80b-4300-8705-5e4f73593032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fae0418f54e41a7b705d5aa0af98aea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:21Z,use_quota=True,user_id='2398686ed72a46df8e949a62b45ec572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe1c895-7c10-4899-b7d1-d7a889ee67c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe1c895-7c10-4899-b7d1-d7a889ee67c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204b345e-62ec-4ad1-be50-9d63fa3d0db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204b345e-62ec-4ad1-be50-9d63fa3d0db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1283719-f80b-4300-8705-5e4f73593032', 'volume_name': 'volume-f1283719-f80b-4300-8705-5e4f73593032', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088f3c39-1a36-43ca-9cbe-938a4d94bd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088f3c39-1a36-43ca-9cbe-938a4d94bd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b4ec73-2a9e-4103-a7b7-0f2b435c8228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:21 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Volume f1283719-f80b-4300-8705-5e4f73593032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1283719-f80b-4300-8705-5e4f73593032', 'volume_size': 1} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1036209065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1283719-f80b-4300-8705-5e4f73593032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fae0418f54e41a7b705d5aa0af98aea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:21Z,use_quota=True,user_id='2398686ed72a46df8e949a62b45ec572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Creating volume f1283719-f80b-4300-8705-5e4f73593032 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:21 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:21 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 1073741824 Sep 07 02:35:21 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:21 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 1073741824" returned: 0 in 0.399s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:21 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 Sep 07 02:35:21 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:22 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032" returned: 0 in 0.250s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b4ec73-2a9e-4103-a7b7-0f2b435c8228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1283719-f80b-4300-8705-5e4f73593032', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f37ee1-17af-4cc8-b271-6a0ef571aae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:22 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Volume volume-f1283719-f80b-4300-8705-5e4f73593032 (f1283719-f80b-4300-8705-5e4f73593032): created successfully Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f37ee1-17af-4cc8-b271-6a0ef571aae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Flow 'volume_create_manager' (b482d489-6420-48e8-835d-c6d2ff961b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:22 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-fffcc685-f954-4066-b73f-3da2b99707b2 tempest-VolumeDependencyTests-780282758 None] Created volume successfully. Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] Creating offline snapshot 17c7cf1d-92c5-4cbb-b51a-9664870207a7 of volume f1283719-f80b-4300-8705-5e4f73593032 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62b78e7-9703-40f7-88d4-c7e38279f653]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:22 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 Sep 07 02:35:22 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:22 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032" returned: 0 in 0.352s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:22 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 1G Sep 07 02:35:22 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:23 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 1G" returned: 0 in 0.378s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1283719-f80b-4300-8705-5e4f73593032 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:23 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1283719-f80b-4300-8705-5e4f73593032 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 Sep 07 02:35:23 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:23 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1283719-f80b-4300-8705-5e4f73593032 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7" returned: 0 in 0.291s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:23 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 is being set with open permissions: ugo+rw Sep 07 02:35:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:23 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 Sep 07 02:35:23 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:23 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7" returned: 0 in 0.239s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:23 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.info Sep 07 02:35:23 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:24 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.info" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:24 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.info is being set with open permissions: ugo+rw Sep 07 02:35:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:24 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.info Sep 07 02:35:24 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:24 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.info" returned: 0 in 0.237s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:24 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ce431e0e-fdda-435b-b892-14494c7b2fb2 tempest-VolumeDependencyTests-780282758 None] Create snapshot completed successfully Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Flow 'volume_create_manager' (7778be44-58f7-47fb-a091-242c0b4f522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380e5d07-3063-43be-8a07-18b9dfe04abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380e5d07-3063-43be-8a07-18b9dfe04abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2099171991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc2d54c-b488-49a6-a045-acfd1ca17e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fae0418f54e41a7b705d5aa0af98aea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17c7cf1d-92c5-4cbb-b51a-9664870207a7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:25Z,use_quota=True,user_id='2398686ed72a46df8e949a62b45ec572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e698f4-9517-476f-82a3-e50ef7656071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e698f4-9517-476f-82a3-e50ef7656071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a76a185-025d-484e-a6cd-2f9df0c42ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a76a185-025d-484e-a6cd-2f9df0c42ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8bc2d54c-b488-49a6-a045-acfd1ca17e37', 'volume_name': 'volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37', 'volume_size': 1, 'snapshot_id': '17c7cf1d-92c5-4cbb-b51a-9664870207a7'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71912912-bf23-4f8c-ba5d-a53410340c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71912912-bf23-4f8c-ba5d-a53410340c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc1e436-b67b-4f97-a33b-2035358f1101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:25 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Volume 8bc2d54c-b488-49a6-a045-acfd1ca17e37: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37', 'volume_size': 1, 'snapshot_id': '17c7cf1d-92c5-4cbb-b51a-9664870207a7'} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Acquiring lock "cinder-quobyte-17c7cf1d-92c5-4cbb-b51a-9664870207a7-8bc2d54c-b488-49a6-a045-acfd1ca17e37" by "_create_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-17c7cf1d-92c5-4cbb-b51a-9664870207a7-8bc2d54c-b488-49a6-a045-acfd1ca17e37" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Creating volume 8bc2d54c-b488-49a6-a045-acfd1ca17e37 from snapshot 17c7cf1d-92c5-4cbb-b51a-9664870207a7 {{(pid=87313) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Acquiring lock "cinder-quobyte-8bc2d54c-b488-49a6-a045-acfd1ca17e37" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-8bc2d54c-b488-49a6-a045-acfd1ca17e37" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] snapshot: 17c7cf1d-92c5-4cbb-b51a-9664870207a7, volume: 8bc2d54c-b488-49a6-a045-acfd1ca17e37, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0695cb-78b2-408f-98df-6662b9bed235]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:25 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 Sep 07 02:35:25 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:25 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7" returned: 0 in 0.347s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1283719-f80b-4300-8705-5e4f73593032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f554cc9-eab8-435e-bde0-72a9e5b0cf09]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:25 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 Sep 07 02:35:25 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:25 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032" returned: 0 in 0.368s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:35:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:25 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 Sep 07 02:35:25 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:26 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:26 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:26 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.297s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:35:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:35:30 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37" returned: 0 in 4.135s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032, size 1024.00 MB, duration 4.14 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:35:30 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Converted 1024.00 MB image at 247.57 MB/s Sep 07 02:35:30 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 is being set with open permissions: ugo+rw Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:30 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 Sep 07 02:35:30 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:30 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-8bc2d54c-b488-49a6-a045-acfd1ca17e37" released by "_copy_volume_from_snapshot" :: held 5.160s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-17c7cf1d-92c5-4cbb-b51a-9664870207a7-8bc2d54c-b488-49a6-a045-acfd1ca17e37" released by "_create_volume_from_snapshot" :: held 5.222s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.237s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc1e436-b67b-4f97-a33b-2035358f1101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37', 'volume_size': 1, 'snapshot_id': '17c7cf1d-92c5-4cbb-b51a-9664870207a7'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffaf2d9-e4a5-4ca0-8602-dc890daa66dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:30 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Volume volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 (8bc2d54c-b488-49a6-a045-acfd1ca17e37): created successfully Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffaf2d9-e4a5-4ca0-8602-dc890daa66dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Flow 'volume_create_manager' (7778be44-58f7-47fb-a091-242c0b4f522f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:30 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-23244be3-5d0a-480f-a5aa-5c11ac078c58 tempest-VolumeDependencyTests-780282758 None] Created volume successfully. Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Acquiring lock "cinder-17c7cf1d-92c5-4cbb-b51a-9664870207a7-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Lock "cinder-17c7cf1d-92c5-4cbb-b51a-9664870207a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Acquiring lock "cinder-quobyte-f1283719-f80b-4300-8705-5e4f73593032" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-f1283719-f80b-4300-8705-5e4f73593032" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Acquiring lock "cinder-quobyte-17c7cf1d-92c5-4cbb-b51a-9664870207a7" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-17c7cf1d-92c5-4cbb-b51a-9664870207a7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Deleting offline snapshot 17c7cf1d-92c5-4cbb-b51a-9664870207a7 of volume f1283719-f80b-4300-8705-5e4f73593032 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] snapshot_file for this snap is: volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82e46ad-bef5-46d4-97b1-9dfdb6417c4b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:30 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 Sep 07 02:35:30 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:30 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7" returned: 0 in 0.355s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1283719-f80b-4300-8705-5e4f73593032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dd485b-e90d-4588-8522-a8288226dd6d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:31 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 Sep 07 02:35:31 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:31 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032" returned: 0 in 0.520s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:31 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 Sep 07 02:35:31 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:31 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7" returned: 0 in 0.316s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:31 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7 Sep 07 02:35:31 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:32 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032.17c7cf1d-92c5-4cbb-b51a-9664870207a7" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-17c7cf1d-92c5-4cbb-b51a-9664870207a7" released by "_delete_snapshot" :: held 1.526s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-f1283719-f80b-4300-8705-5e4f73593032" released by "delete_snapshot" :: held 1.546s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:32 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Created reservations ['fd3b6f4f-ea43-4c50-8e53-a2ce922f0f2f', '4cd0d3e1-f391-4347-9e32-f46693ea7c0a', 'c5c6ebda-45f5-46fd-b694-6c873f4bdd81', '6b1c0445-33ea-4940-a3a7-2a75f17acc1a'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:32 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Delete snapshot completed successfully. Sep 07 02:35:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-67444feb-dbc6-4735-9228-e3472756496e tempest-VolumeDependencyTests-780282758 None] Lock "cinder-17c7cf1d-92c5-4cbb-b51a-9664870207a7-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Acquiring lock "cinder-f1283719-f80b-4300-8705-5e4f73593032-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Lock "cinder-f1283719-f80b-4300-8705-5e4f73593032-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Acquiring lock "cinder-quobyte-f1283719-f80b-4300-8705-5e4f73593032" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-f1283719-f80b-4300-8705-5e4f73593032" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:32 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a090b110-f5a2-4cd5-adb8-e09e6537ccce]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:32 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 Sep 07 02:35:32 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:33 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032" returned: 0 in 0.354s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:33 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032 Sep 07 02:35:33 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:33 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f1283719-f80b-4300-8705-5e4f73593032" returned: 0 in 0.252s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-f1283719-f80b-4300-8705-5e4f73593032" released by "delete_volume" :: held 0.657s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Created reservations ['fc118b25-cb16-44fd-a987-5be0c47e80e8', 'e1a1726e-e114-4e1a-9648-0773eb938934', 'bc47b3d4-2f2d-4b87-842b-817b3d876212', '4c110b21-86aa-4587-971f-7fca050e43c8'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:33 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:33 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:33 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.237s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:33 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Deleted volume successfully. Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e05a53f1-7bde-48f0-b62c-3a6d322066ad tempest-VolumeDependencyTests-780282758 None] Lock "cinder-f1283719-f80b-4300-8705-5e4f73593032-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Acquiring lock "cinder-8bc2d54c-b488-49a6-a045-acfd1ca17e37-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Lock "cinder-8bc2d54c-b488-49a6-a045-acfd1ca17e37-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Acquiring lock "cinder-quobyte-8bc2d54c-b488-49a6-a045-acfd1ca17e37" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-8bc2d54c-b488-49a6-a045-acfd1ca17e37" acquired by "delete_volume" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[39933c61-df32-4e40-954d-f4fd2deb2a21]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:34 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 Sep 07 02:35:34 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:34 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37" returned: 0 in 0.348s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:34 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37 Sep 07 02:35:34 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:34 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8bc2d54c-b488-49a6-a045-acfd1ca17e37" returned: 0 in 0.248s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Lock "cinder-quobyte-8bc2d54c-b488-49a6-a045-acfd1ca17e37" released by "delete_volume" :: held 0.635s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Created reservations ['61e60494-01e1-4e6e-9889-38cb8565e219', '013f01ed-0a78-4567-b7dc-2f56848ec181', '92d22c86-57f2-4e21-8744-dc408b534657', '99be6010-412a-441c-83ea-23b0d643d441'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:34 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:34 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:34 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Deleted volume successfully. Sep 07 02:35:34 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8be0e5eb-5f6e-44e8-b507-f7517bc76ec0 tempest-VolumeDependencyTests-780282758 None] Lock "cinder-8bc2d54c-b488-49a6-a045-acfd1ca17e37-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:44 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=71,cinder:UPDATE=101,cinder:INSERT=24,cinder:DELETE=10 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Flow 'volume_create_manager' (96a5bf00-f9d4-4894-806b-78adaa112f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac620e3-2202-4ea8-9a80-14dbf820cfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (a40c1c87-3a2f-4f92-be0d-865e9c3d1515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c7dda5-6e8c-4741-ba11-fc9030d9079a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac620e3-2202-4ea8-9a80-14dbf820cfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1500809483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825300ab-22f7-4de5-8d73-4e725e8994cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763d97f1c114a36bf78d8191ce18dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:47Z,use_quota=True,user_id='3bdb463b219b491b848e4bf5736e7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd0f424-f174-446f-9d13-20e064e4d5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd0f424-f174-446f-9d13-20e064e4d5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f810f9e3-f48e-455c-8fc8-0fe7238097cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f810f9e3-f48e-455c-8fc8-0fe7238097cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825300ab-22f7-4de5-8d73-4e725e8994cd', 'volume_name': 'volume-825300ab-22f7-4de5-8d73-4e725e8994cd', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700c1566-c3e0-49a8-a001-be5bc2060531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700c1566-c3e0-49a8-a001-be5bc2060531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea49b6b2-4100-46ef-a696-e3d55ec55a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:46 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Volume 825300ab-22f7-4de5-8d73-4e725e8994cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825300ab-22f7-4de5-8d73-4e725e8994cd', 'volume_size': 1} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1500809483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825300ab-22f7-4de5-8d73-4e725e8994cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763d97f1c114a36bf78d8191ce18dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:47Z,use_quota=True,user_id='3bdb463b219b491b848e4bf5736e7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Creating volume 825300ab-22f7-4de5-8d73-4e725e8994cd {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:46 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:46 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd 1073741824 Sep 07 02:35:47 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c7dda5-6e8c-4741-ba11-fc9030d9079a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-206277051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a214368-808c-4292-8900-b672abf6e56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:47Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eaa9363-c89c-4f24-8cfd-ed8d3287692a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eaa9363-c89c-4f24-8cfd-ed8d3287692a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8c44e5-b9de-4802-b2b8-308952545871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8c44e5-b9de-4802-b2b8-308952545871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a214368-808c-4292-8900-b672abf6e56f', 'volume_name': 'volume-1a214368-808c-4292-8900-b672abf6e56f', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82f3c9f-77aa-4d91-86b6-c09ac0db71b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82f3c9f-77aa-4d91-86b6-c09ac0db71b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834447a2-38e6-4e35-9637-7ba7e911a2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume 1a214368-808c-4292-8900-b672abf6e56f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a214368-808c-4292-8900-b672abf6e56f', 'volume_size': 1} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Flow 'volume_create_manager' (7be878f0-ab29-4e40-871a-7561dcada3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ea3283-783e-472b-bded-c54a9324c93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ea3283-783e-472b-bded-c54a9324c93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050866807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b9ddd5-5f95-4903-8a75-ba2589d13bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763d97f1c114a36bf78d8191ce18dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:47Z,use_quota=True,user_id='3bdb463b219b491b848e4bf5736e7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329e7d58-38a8-437c-84af-33a45ea681a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329e7d58-38a8-437c-84af-33a45ea681a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e864545-c321-4e27-b0e0-c9bb7c45b712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e864545-c321-4e27-b0e0-c9bb7c45b712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b9ddd5-5f95-4903-8a75-ba2589d13bae', 'volume_name': 'volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83ae192-5dfd-435f-a1bc-1c41bf6fb670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83ae192-5dfd-435f-a1bc-1c41bf6fb670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64cf749-18a4-4eb7-b3ef-f81a71f56571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Volume 11b9ddd5-5f95-4903-8a75-ba2589d13bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae', 'volume_size': 1} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Flow 'volume_create_manager' (fa6f669f-2298-4109-ae83-15c05649a8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0b4b03-5a06-4e91-b5d4-7e8dd6b5754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0b4b03-5a06-4e91-b5d4-7e8dd6b5754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1210914051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6ebf48b78843d5ad13b447ff57ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:47Z,use_quota=True,user_id='833ddb37f114491dbd1191d4e81203d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94d898b-a33b-44e6-bbfc-632ebf4b31d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94d898b-a33b-44e6-bbfc-632ebf4b31d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d028928-e403-4ac7-9809-778d714d1dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d028928-e403-4ac7-9809-778d714d1dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c18d7e-85a5-4f0e-8ffe-515bd3781f1a', 'volume_name': 'volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5739b84-6983-472c-ab82-fbc951dbef6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5739b84-6983-472c-ab82-fbc951dbef6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261be203-de6d-4a6a-82e8-e06735b3a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Volume d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a', 'volume_size': 1} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:47 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd 1073741824" returned: 0 in 0.608s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:47 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd Sep 07 02:35:47 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Flow 'volume_create_manager' (8f5647a2-0cc6-4519-8f8a-a69c4145ae0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0614128-7124-413d-93f0-c28ea84b3823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0614128-7124-413d-93f0-c28ea84b3823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1504643427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080df788-f213-4bdd-b590-43100e6e9478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763d97f1c114a36bf78d8191ce18dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:48Z,use_quota=True,user_id='3bdb463b219b491b848e4bf5736e7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5bf85b-443f-454d-8b8d-c75a11361127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5bf85b-443f-454d-8b8d-c75a11361127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b840e92e-bcf3-4222-9aa7-773b1244051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b840e92e-bcf3-4222-9aa7-773b1244051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080df788-f213-4bdd-b590-43100e6e9478', 'volume_name': 'volume-080df788-f213-4bdd-b590-43100e6e9478', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496ddba8-a42a-4cb8-85fe-8d6b98242758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496ddba8-a42a-4cb8-85fe-8d6b98242758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a687da0f-147b-4801-98ab-4000da159720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Volume 080df788-f213-4bdd-b590-43100e6e9478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080df788-f213-4bdd-b590-43100e6e9478', 'volume_size': 1} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:47 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd" returned: 0 in 0.326s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.873s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-206277051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a214368-808c-4292-8900-b672abf6e56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:47Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Creating volume 1a214368-808c-4292-8900-b672abf6e56f {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:47 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea49b6b2-4100-46ef-a696-e3d55ec55a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825300ab-22f7-4de5-8d73-4e725e8994cd', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98024f5-fe2c-4d2d-a8b0-764182fde29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:47 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f 1073741824 Sep 07 02:35:47 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:48 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Volume volume-825300ab-22f7-4de5-8d73-4e725e8994cd (825300ab-22f7-4de5-8d73-4e725e8994cd): created successfully Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98024f5-fe2c-4d2d-a8b0-764182fde29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Flow 'volume_create_manager' (96a5bf00-f9d4-4894-806b-78adaa112f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:48 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1d2fccf5-5159-45cd-894e-b391275c2cbb tempest-CreateVolumesFromImageTest-333397335 None] Created volume successfully. Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Flow 'volume_create_manager' (f67ae07f-8768-4a05-90eb-694fcd94a794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e33e30a-8f38-4976-a0e4-e39e42637fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e33e30a-8f38-4976-a0e4-e39e42637fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1385717837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b40d2b-6f87-4d76-8200-a093332c2f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763d97f1c114a36bf78d8191ce18dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:48Z,use_quota=True,user_id='3bdb463b219b491b848e4bf5736e7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee791f17-f22f-4cb3-8750-fe7186d10900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee791f17-f22f-4cb3-8750-fe7186d10900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1baf4afe-e762-4065-971d-abb989b83150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1baf4afe-e762-4065-971d-abb989b83150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b40d2b-6f87-4d76-8200-a093332c2f8c', 'volume_name': 'volume-37b40d2b-6f87-4d76-8200-a093332c2f8c', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c020664e-6856-491c-aa26-272508901598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c020664e-6856-491c-aa26-272508901598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835f7e54-ce13-4107-bf1a-b49c27c7b4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:48 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Volume 37b40d2b-6f87-4d76-8200-a093332c2f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b40d2b-6f87-4d76-8200-a093332c2f8c', 'volume_size': 1} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:48 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Flow 'volume_create_manager' (b67167f6-1dfe-4629-84dc-692a61c4f9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f53f5c-3bfd-4486-b885-ca333fc5cda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f 1073741824" returned: 0 in 0.635s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f53f5c-3bfd-4486-b885-ca333fc5cda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1599736475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b523ff9f-c239-4c58-856e-e3739f38c1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763d97f1c114a36bf78d8191ce18dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:49Z,use_quota=True,user_id='3bdb463b219b491b848e4bf5736e7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c604da64-2874-43d3-82c2-770492f9d275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c604da64-2874-43d3-82c2-770492f9d275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dbd78a-7c3f-445d-929a-5c9a06dabb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dbd78a-7c3f-445d-929a-5c9a06dabb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b523ff9f-c239-4c58-856e-e3739f38c1fe', 'volume_name': 'volume-b523ff9f-c239-4c58-856e-e3739f38c1fe', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3218750-726d-4e35-bf33-10ea103e300a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3218750-726d-4e35-bf33-10ea103e300a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d65bc4-853e-4141-be83-30b63c747b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:48 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Volume b523ff9f-c239-4c58-856e-e3739f38c1fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b523ff9f-c239-4c58-856e-e3739f38c1fe', 'volume_size': 1} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:48 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f Sep 07 02:35:48 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:48 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.676s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050866807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b9ddd5-5f95-4903-8a75-ba2589d13bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763d97f1c114a36bf78d8191ce18dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:47Z,use_quota=True,user_id='3bdb463b219b491b848e4bf5736e7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Creating volume 11b9ddd5-5f95-4903-8a75-ba2589d13bae {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:48 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834447a2-38e6-4e35-9637-7ba7e911a2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a214368-808c-4292-8900-b672abf6e56f', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5637bcda-a999-4a51-8cb0-b6874ea1ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:48 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae 1073741824 Sep 07 02:35:48 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:48 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume volume-1a214368-808c-4292-8900-b672abf6e56f (1a214368-808c-4292-8900-b672abf6e56f): created successfully Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5637bcda-a999-4a51-8cb0-b6874ea1ed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (a40c1c87-3a2f-4f92-be0d-865e9c3d1515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:49 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8fc6e77c-3cbc-487a-a820-53209b2a28b4 tempest-CreateVolumesFromSnapshotTest-289206986 None] Created volume successfully. Sep 07 02:35:49 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae 1073741824" returned: 0 in 0.481s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:49 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae Sep 07 02:35:49 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:49 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae" returned: 0 in 0.256s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.174s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1210914051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6ebf48b78843d5ad13b447ff57ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:47Z,use_quota=True,user_id='833ddb37f114491dbd1191d4e81203d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Creating volume d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:49 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64cf749-18a4-4eb7-b3ef-f81a71f56571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:49 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a 1073741824 Sep 07 02:35:49 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bf659e-9b4f-4257-bfc7-4cfef9f8f2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:49 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Volume volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae (11b9ddd5-5f95-4903-8a75-ba2589d13bae): created successfully Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bf659e-9b4f-4257-bfc7-4cfef9f8f2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Flow 'volume_create_manager' (7be878f0-ab29-4e40-871a-7561dcada3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:49 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7ccce80d-f411-4f6e-b61e-958c6c0afa5c tempest-CreateVolumesFromImageTest-333397335 None] Created volume successfully. Sep 07 02:35:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:50 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a 1073741824" returned: 0 in 0.526s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:50 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a Sep 07 02:35:50 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:50 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" returned: 0 in 0.270s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.713s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1504643427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080df788-f213-4bdd-b590-43100e6e9478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763d97f1c114a36bf78d8191ce18dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:48Z,use_quota=True,user_id='3bdb463b219b491b848e4bf5736e7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Creating volume 080df788-f213-4bdd-b590-43100e6e9478 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:50 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:50 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478 1073741824 Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261be203-de6d-4a6a-82e8-e06735b3a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:50 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bc7b2e-2730-4894-8b22-2ce1b75704e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:50 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Volume volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a (d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a): created successfully Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bc7b2e-2730-4894-8b22-2ce1b75704e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Flow 'volume_create_manager' (fa6f669f-2298-4109-ae83-15c05649a8f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f1cfca60-732f-498f-bce4-699e9639842b tempest-VolumeDependencyTests-953298579 None] Created volume successfully. Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Flow 'volume_create_manager' (b58fc42d-ee1c-4c52-9d07-a004c575487f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b4c1af-a0d8-40ed-9a48-8e02ba2f36de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b4c1af-a0d8-40ed-9a48-8e02ba2f36de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08713a19-9fd9-4d84-b374-8e979f4ada3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de871f2ca8e349cd95c773fc1c513274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:51Z,use_quota=True,user_id='0a5895b2bbf44351ba67dc24ce96017f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d01599f-e17f-4e2e-abd2-ebf200cb8d63),volume_type_id=8d01599f-e17f-4e2e-abd2-ebf200cb8d63)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4c644b-8729-4a70-a45f-f2adc7cfded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4c644b-8729-4a70-a45f-f2adc7cfded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0742dd85-aac4-4d92-b52a-caf4883d66c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:50 devstack cinder-volume[87313]: DEBUG cinder.image.glance [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Creating Keystone auth plugin from conf {{(pid=87313) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 02:35:51 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478 1073741824" returned: 0 in 0.494s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0742dd85-aac4-4d92-b52a-caf4883d66c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08713a19-9fd9-4d84-b374-8e979f4ada3e', 'volume_name': 'volume-08713a19-9fd9-4d84-b374-8e979f4ada3e', 'volume_size': 1, 'image_id': 'e476671d-6835-4f81-a84d-9d4f6d31b486', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e476671d-6835-4f81-a84d-9d4f6d31b486', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7eebcafdb810bec9b8b3368b9837b63f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de871f2ca8e349cd95c773fc1c513274', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '07760a1a15fb8123b451e43f3bbf9f1c6f7a12ce3ab759ac9c7c36689b1ad2baad313cfca1a4cc753f11bf7916f7b352675b29fbece53695758892e22b8d1ffb', 'id': 'e476671d-6835-4f81-a84d-9d4f6d31b486', 'created_at': datetime.datetime(2026, 9, 7, 0, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e476671d-6835-4f81-a84d-9d4f6d31b486/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1a1757-49fc-4a7c-89f6-f12eaa5e69f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1a1757-49fc-4a7c-89f6-f12eaa5e69f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2f82f3-3bd7-4703-bc8b-0b47c948a530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:51 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Volume 08713a19-9fd9-4d84-b374-8e979f4ada3e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08713a19-9fd9-4d84-b374-8e979f4ada3e', 'volume_size': 1, 'image_id': 'e476671d-6835-4f81-a84d-9d4f6d31b486', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e476671d-6835-4f81-a84d-9d4f6d31b486', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7eebcafdb810bec9b8b3368b9837b63f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de871f2ca8e349cd95c773fc1c513274', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '07760a1a15fb8123b451e43f3bbf9f1c6f7a12ce3ab759ac9c7c36689b1ad2baad313cfca1a4cc753f11bf7916f7b352675b29fbece53695758892e22b8d1ffb', 'id': 'e476671d-6835-4f81-a84d-9d4f6d31b486', 'created_at': datetime.datetime(2026, 9, 7, 0, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e476671d-6835-4f81-a84d-9d4f6d31b486/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Trying to clone 08713a19-9fd9-4d84-b374-8e979f4ada3e from image e476671d-6835-4f81-a84d-9d4f6d31b486 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e476671d-6835-4f81-a84d-9d4f6d31b486', 'metadata': {}}]). {{(pid=87313) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:51 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478 Sep 07 02:35:51 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 02:35:51 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Image download 0.00 MB at 0.00 MB/s Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[3496a5c1-850a-4ea7-9b4e-8e43562df482]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:51 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD Sep 07 02:35:51 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:51 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478" returned: 0 in 0.251s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.136s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1385717837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b40d2b-6f87-4d76-8200-a093332c2f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763d97f1c114a36bf78d8191ce18dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:48Z,use_quota=True,user_id='3bdb463b219b491b848e4bf5736e7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Creating volume 37b40d2b-6f87-4d76-8200-a093332c2f8c {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:51 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a687da0f-147b-4801-98ab-4000da159720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080df788-f213-4bdd-b590-43100e6e9478', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13bb6a2-f2c7-4936-a058-f9cba1ccf3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:51 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c 1073741824 Sep 07 02:35:51 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:51 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Volume volume-080df788-f213-4bdd-b590-43100e6e9478 (080df788-f213-4bdd-b590-43100e6e9478): created successfully Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13bb6a2-f2c7-4936-a058-f9cba1ccf3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Flow 'volume_create_manager' (8f5647a2-0cc6-4519-8f8a-a69c4145ae0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:51 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-cdf65d8f-3a95-4cce-9441-dc74d90844ab tempest-CreateVolumesFromImageTest-333397335 None] Created volume successfully. Sep 07 02:35:51 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:51 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD Sep 07 02:35:51 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:51 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c 1073741824" returned: 0 in 0.512s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:51 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c Sep 07 02:35:51 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:51 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD" returned: 1 in 0.416s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:35:51 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Temporary image e476671d-6835-4f81-a84d-9d4f6d31b486 is fetched for user 0a5895b2bbf44351ba67dc24ce96017f. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[575e17ac-d1b0-49ce-8d83-eb104e69cdbc]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:52 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD Sep 07 02:35:52 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:52 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c" returned: 0 in 0.254s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.552s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1599736475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b523ff9f-c239-4c58-856e-e3739f38c1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3763d97f1c114a36bf78d8191ce18dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:49Z,use_quota=True,user_id='3bdb463b219b491b848e4bf5736e7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Creating volume b523ff9f-c239-4c58-856e-e3739f38c1fe {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:52 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835f7e54-ce13-4107-bf1a-b49c27c7b4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b40d2b-6f87-4d76-8200-a093332c2f8c', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a364543f-4a77-4742-9cc9-ecddec6730f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:52 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe 1073741824 Sep 07 02:35:52 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:52 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Volume volume-37b40d2b-6f87-4d76-8200-a093332c2f8c (37b40d2b-6f87-4d76-8200-a093332c2f8c): created successfully Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a364543f-4a77-4742-9cc9-ecddec6730f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Flow 'volume_create_manager' (f67ae07f-8768-4a05-90eb-694fcd94a794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0dcf6034-f339-481b-a7ba-616f59991d3f tempest-CreateVolumesFromImageTest-333397335 None] Created volume successfully. Sep 07 02:35:52 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:52 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD Sep 07 02:35:52 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:52 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe 1073741824" returned: 0 in 0.421s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:52 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe Sep 07 02:35:52 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:52 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:52 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe" returned: 0 in 0.254s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.930s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d65bc4-853e-4141-be83-30b63c747b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b523ff9f-c239-4c58-856e-e3739f38c1fe', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25b359a-cbfa-4345-be7a-23695b4448d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] Creating offline snapshot 1d2df7fe-3535-4dc6-8726-2e003c843102 of volume 1a214368-808c-4292-8900-b672abf6e56f {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:35:52 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Volume volume-b523ff9f-c239-4c58-856e-e3739f38c1fe (b523ff9f-c239-4c58-856e-e3739f38c1fe): created successfully Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25b359a-cbfa-4345-be7a-23695b4448d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Flow 'volume_create_manager' (b67167f6-1dfe-4629-84dc-692a61c4f9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[09234693-8c41-487d-91aa-13155aba9444]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f9a67ceb-3921-4a57-aaca-8e1da2fa9d3f tempest-CreateVolumesFromImageTest-333397335 None] Created volume successfully. Sep 07 02:35:53 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f Sep 07 02:35:53 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:53 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f" returned: 0 in 0.362s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:53 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 1G Sep 07 02:35:53 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:53 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 1G" returned: 0 in 0.420s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a214368-808c-4292-8900-b672abf6e56f -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:53 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a214368-808c-4292-8900-b672abf6e56f -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 Sep 07 02:35:53 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:54 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a214368-808c-4292-8900-b672abf6e56f -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102" returned: 0 in 0.300s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:54 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 is being set with open permissions: ugo+rw Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:54 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 Sep 07 02:35:54 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "cinder-b523ff9f-c239-4c58-856e-e3739f38c1fe-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-b523ff9f-c239-4c58-856e-e3739f38c1fe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "cinder-quobyte-b523ff9f-c239-4c58-856e-e3739f38c1fe" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-quobyte-b523ff9f-c239-4c58-856e-e3739f38c1fe" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d92b35-d1d7-4d8d-99f8-13dec9cb8c44]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:54 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102" returned: 0 in 0.254s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:54 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe Sep 07 02:35:54 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:54 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.info Sep 07 02:35:54 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:54 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe" returned: 0 in 0.362s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:54 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe Sep 07 02:35:54 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:54 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.info" returned: 0 in 0.264s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:54 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.info is being set with open permissions: ugo+rw Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:54 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.info Sep 07 02:35:54 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:54 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b523ff9f-c239-4c58-856e-e3739f38c1fe" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-quobyte-b523ff9f-c239-4c58-856e-e3739f38c1fe" released by "delete_volume" :: held 0.657s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:54 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.info" returned: 0 in 0.253s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.088s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-37b2fb19-e9e8-4ca7-a04b-4192fd0bb0a8 tempest-CreateVolumesFromSnapshotTest-289206986 None] Create snapshot completed successfully Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] Creating offline snapshot 8072d0c6-25d2-4650-b3cf-ff4b3b65292c of volume d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5614b6-3324-4b8c-b03c-7245852c5fbe]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Created reservations ['6e47ed55-1bf8-4a2e-bc2b-4002c8454f68', 'ff49cd42-9fcf-48db-8888-6e971a3dced1', 'a76f113c-724f-4a14-a254-b6a5be7471aa', '304a08dc-c568-489d-915a-135475214a60'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:55 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a Sep 07 02:35:55 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:55 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:55 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "cinder-37b40d2b-6f87-4d76-8200-a093332c2f8c-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-37b40d2b-6f87-4d76-8200-a093332c2f8c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:55 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.312s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "cinder-quobyte-37b40d2b-6f87-4d76-8200-a093332c2f8c" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:55 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Deleted volume successfully. Sep 07 02:35:55 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" returned: 0 in 0.436s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-quobyte-37b40d2b-6f87-4d76-8200-a093332c2f8c" acquired by "delete_volume" :: waited 0.043s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:55 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c 1G Sep 07 02:35:55 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fdacdf6b-0923-4852-bef8-b4dbef6160aa tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-b523ff9f-c239-4c58-856e-e3739f38c1fe-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[592bd5ce-22a6-4f64-a3bd-c80738f98159]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:55 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c Sep 07 02:35:55 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (9bf231bc-46f5-441e-a955-521f979acc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b033d3-72c3-41ac-ba2f-79de7052cff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b033d3-72c3-41ac-ba2f-79de7052cff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1113741148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b751f371-460f-40f4-8a21-99b9870e2cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:56Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a6396e-b2ca-4edc-815a-8a72155fa8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a6396e-b2ca-4edc-815a-8a72155fa8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc97ccf-b507-4f21-b4b9-35dea0765977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc97ccf-b507-4f21-b4b9-35dea0765977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b751f371-460f-40f4-8a21-99b9870e2cac', 'volume_name': 'volume-b751f371-460f-40f4-8a21-99b9870e2cac', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686420c9-9de9-447d-9ef3-7c689c827ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686420c9-9de9-447d-9ef3-7c689c827ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63bf31b4-177b-4e5c-bdfa-77d6191ebdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:55 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume b751f371-460f-40f4-8a21-99b9870e2cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b751f371-460f-40f4-8a21-99b9870e2cac', 'volume_size': 1} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:55 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:55 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c" returned: 0 in 0.437s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c 1G" returned: 0 in 0.516s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:55 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c Sep 07 02:35:55 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:56 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c Sep 07 02:35:56 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (fdec3237-d2d1-4cb8-b4e9-c8178bd691b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7c0b6d-1322-49b4-910f-25c54ad27cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7c0b6d-1322-49b4-910f-25c54ad27cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-847840590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a62a4b2-8448-4e2d-a665-4a027616699a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:56Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e32a5f-bdfa-4ae6-83fd-a0a88d4ea5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e32a5f-bdfa-4ae6-83fd-a0a88d4ea5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8979f3d-61a4-4f14-983d-9e6db9bc5b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8979f3d-61a4-4f14-983d-9e6db9bc5b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a62a4b2-8448-4e2d-a665-4a027616699a', 'volume_name': 'volume-3a62a4b2-8448-4e2d-a665-4a027616699a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da906e7-daeb-4bcb-b548-0faf86e830fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:56 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da906e7-daeb-4bcb-b548-0faf86e830fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c36ea4a-1146-405d-a586-1173b5cb04d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:56 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume 3a62a4b2-8448-4e2d-a665-4a027616699a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a62a4b2-8448-4e2d-a665-4a027616699a', 'volume_size': 1} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-37b40d2b-6f87-4d76-8200-a093332c2f8c" returned: 0 in 0.387s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-quobyte-37b40d2b-6f87-4d76-8200-a093332c2f8c" released by "delete_volume" :: held 0.887s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Created reservations ['7d9c5c20-c177-4ad8-8ced-56e2490589b5', '690e2912-2381-4fbc-8beb-4522d7fa6efb', 'db846717-c9e1-4ea6-bb6b-9cdb65341e65', '23070097-61d6-4e9e-b3d0-1a4fd2a7bf23'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:56 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c" returned: 0 in 0.482s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:56 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c is being set with open permissions: ugo+rw Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:56 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c Sep 07 02:35:56 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:56 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:56 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (4de82412-42f6-44eb-82f9-9d3f71ccc99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e216daaa-30df-4361-b1b2-1ee36d7f9246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e216daaa-30df-4361-b1b2-1ee36d7f9246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1519976432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f3b0cf-1847-4ee1-b30d-5664a6348e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:56Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1020ec88-8519-4ed9-8aba-93de6b689c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1020ec88-8519-4ed9-8aba-93de6b689c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291bdfd9-b70e-4d02-a8ad-9982702cf672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291bdfd9-b70e-4d02-a8ad-9982702cf672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f3b0cf-1847-4ee1-b30d-5664a6348e76', 'volume_name': 'volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5c1058-d9cc-4781-880f-07afacb34581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5c1058-d9cc-4781-880f-07afacb34581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76d1ab9-c583-46f2-92a3-94b723e6b5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:56 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume c7f3b0cf-1847-4ee1-b30d-5664a6348e76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76', 'volume_size': 1} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:56 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c" returned: 0 in 0.347s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:56 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.313s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:56 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Deleted volume successfully. Sep 07 02:35:56 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.info Sep 07 02:35:56 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f672fed3-fd75-4ab6-81b2-0ef8f46e8ac1 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-37b40d2b-6f87-4d76-8200-a093332c2f8c-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (cd942311-da35-4daa-a97c-cac45cc64cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913fcafa-1730-4e8d-a6ba-e76561d200b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:56 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913fcafa-1730-4e8d-a6ba-e76561d200b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1499022780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a770f8c-6dd4-44bc-9620-15fcfdef14c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:57Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1dfeb6-b4c1-4036-a570-b491ba82e6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1dfeb6-b4c1-4036-a570-b491ba82e6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a7ee0d-1f63-4c6c-8875-398414f2bc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a7ee0d-1f63-4c6c-8875-398414f2bc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a770f8c-6dd4-44bc-9620-15fcfdef14c8', 'volume_name': 'volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedb5632-4071-41c7-baef-fb664ec4c116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedb5632-4071-41c7-baef-fb664ec4c116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdaa9366-92a3-4d25-81ea-a1814c6a5484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:57 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume 9a770f8c-6dd4-44bc-9620-15fcfdef14c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8', 'volume_size': 1} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:57 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.info" returned: 0 in 0.307s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:57 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.info is being set with open permissions: ugo+rw Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:57 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.info Sep 07 02:35:57 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (f1f35899-91c7-4f49-8e51-038b2a725892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a691ed-0b58-440f-9b51-4ee28267d918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a691ed-0b58-440f-9b51-4ee28267d918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1907678124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1abc34-5f8c-46c9-8f8c-54b5697d5518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:57Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3bc9ec8-454a-41eb-a3ab-8a51cda8860f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3bc9ec8-454a-41eb-a3ab-8a51cda8860f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:57 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028655f3-1c24-4c2e-8817-50dbe71788ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028655f3-1c24-4c2e-8817-50dbe71788ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af1abc34-5f8c-46c9-8f8c-54b5697d5518', 'volume_name': 'volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1bd39c-fe96-4b9b-9848-455a51f58b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1bd39c-fe96-4b9b-9848-455a51f58b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4ffcf7-c4a6-4b53-926e-8f37ec988fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:57 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume af1abc34-5f8c-46c9-8f8c-54b5697d5518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518', 'volume_size': 1} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.info" returned: 0 in 0.276s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.532s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.679s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08713a19-9fd9-4d84-b374-8e979f4ada3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de871f2ca8e349cd95c773fc1c513274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:51Z,use_quota=True,user_id='0a5895b2bbf44351ba67dc24ce96017f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d01599f-e17f-4e2e-abd2-ebf200cb8d63),volume_type_id=8d01599f-e17f-4e2e-abd2-ebf200cb8d63)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Creating volume 08713a19-9fd9-4d84-b374-8e979f4ada3e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:57 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:57 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e 1073741824 Sep 07 02:35:57 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:57 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f12bfac8-b359-4f26-a66f-1834d03caf36 tempest-VolumeDependencyTests-953298579 None] Create snapshot completed successfully Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "cinder-080df788-f213-4bdd-b590-43100e6e9478-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-080df788-f213-4bdd-b590-43100e6e9478-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "cinder-quobyte-080df788-f213-4bdd-b590-43100e6e9478" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-quobyte-080df788-f213-4bdd-b590-43100e6e9478" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82898ea-57c3-4658-9c85-cb587b624aae]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:57 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478 Sep 07 02:35:57 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:57 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e 1073741824" returned: 0 in 0.412s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:57 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e Sep 07 02:35:57 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:58 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478" returned: 0 in 0.397s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:58 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478 Sep 07 02:35:58 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:58 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e" returned: 0 in 0.272s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.291s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1113741148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b751f371-460f-40f4-8a21-99b9870e2cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:56Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Creating volume b751f371-460f-40f4-8a21-99b9870e2cac {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:58 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:58 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac 1073741824 Sep 07 02:35:58 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Attempting download of e476671d-6835-4f81-a84d-9d4f6d31b486 ((None, [{'url': 'file:///opt/stack/data/glance/images/e476671d-6835-4f81-a84d-9d4f6d31b486', 'metadata': {}}])) to volume 08713a19-9fd9-4d84-b374-8e979f4ada3e. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a633a6-776d-4f44-9ae3-5749dd500636]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e476671d-6835-4f81-a84d-9d4f6d31b486_i1vx1giu {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:58 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-080df788-f213-4bdd-b590-43100e6e9478" returned: 0 in 0.313s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-quobyte-080df788-f213-4bdd-b590-43100e6e9478" released by "delete_volume" :: held 0.758s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:58 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e476671d-6835-4f81-a84d-9d4f6d31b486_i1vx1giu Sep 07 02:35:58 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Created reservations ['78cb0852-22a7-4833-b7de-be48d8756234', '61896ee0-4363-4068-ac48-eba52919617e', 'c109c8d2-699e-463d-84b8-611f5b9b3745', '1c286cc0-ae94-4b96-baba-ac368be5a78e'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:58 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:35:58 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:58 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:58 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e476671d-6835-4f81-a84d-9d4f6d31b486_i1vx1giu" returned: 0 in 0.475s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e476671d-6835-4f81-a84d-9d4f6d31b486_i1vx1giu {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac 1073741824" returned: 0 in 0.643s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "cinder-11b9ddd5-5f95-4903-8a75-ba2589d13bae-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Flow 'volume_create_manager' (e407a970-514d-4a3c-85cd-861a7ec0b60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1515b98a-5b7a-4825-ba7d-e5a3e4da3503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-11b9ddd5-5f95-4903-8a75-ba2589d13bae-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:58 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.365s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1515b98a-5b7a-4825-ba7d-e5a3e4da3503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1767379698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd61f1f3-c254-4368-9376-cc52cac39d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6ebf48b78843d5ad13b447ff57ba6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8072d0c6-25d2-4650-b3cf-ff4b3b65292c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:59Z,use_quota=True,user_id='833ddb37f114491dbd1191d4e81203d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b8a96b-755d-4140-ad0a-3cdd4a0c46a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b8a96b-755d-4140-ad0a-3cdd4a0c46a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2d871c-9657-4085-9452-ee399f664ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2d871c-9657-4085-9452-ee399f664ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bd61f1f3-c254-4368-9376-cc52cac39d14', 'volume_name': 'volume-bd61f1f3-c254-4368-9376-cc52cac39d14', 'volume_size': 1, 'snapshot_id': '8072d0c6-25d2-4650-b3cf-ff4b3b65292c'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939b76b9-bc44-4b18-9273-e064b5175686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939b76b9-bc44-4b18-9273-e064b5175686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b54f217-4f63-4cdd-9ddd-3efd9ad96416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:58 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Volume bd61f1f3-c254-4368-9376-cc52cac39d14: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bd61f1f3-c254-4368-9376-cc52cac39d14', 'volume_size': 1, 'snapshot_id': '8072d0c6-25d2-4650-b3cf-ff4b3b65292c'} Sep 07 02:35:58 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Deleted volume successfully. Sep 07 02:35:58 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e476671d-6835-4f81-a84d-9d4f6d31b486_i1vx1giu Sep 07 02:35:58 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:59 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac Sep 07 02:35:59 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "cinder-quobyte-11b9ddd5-5f95-4903-8a75-ba2589d13bae" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-quobyte-11b9ddd5-5f95-4903-8a75-ba2589d13bae" acquired by "delete_volume" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-d5c90685-c699-4ca2-9e04-737682205bb0 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-080df788-f213-4bdd-b590-43100e6e9478-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a21dd1-aca6-4fc9-bb12-4b50bea34a77]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:59 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e476671d-6835-4f81-a84d-9d4f6d31b486_i1vx1giu" returned: 1 in 0.435s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e476671d-6835-4f81-a84d-9d4f6d31b486_i1vx1giu' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[381cc76d-e1d4-4666-a37a-66871c13677c]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:59 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae Sep 07 02:35:59 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:59 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac" returned: 0 in 0.257s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.983s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-847840590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a62a4b2-8448-4e2d-a665-4a027616699a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:56Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Creating volume 3a62a4b2-8448-4e2d-a665-4a027616699a {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:35:59 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63bf31b4-177b-4e5c-bdfa-77d6191ebdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b751f371-460f-40f4-8a21-99b9870e2cac', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60373bfe-e941-4544-bf5d-ba854b22e1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:35:59 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a 1073741824 Sep 07 02:35:59 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD Sep 07 02:35:59 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:59 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:59 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume volume-b751f371-460f-40f4-8a21-99b9870e2cac (b751f371-460f-40f4-8a21-99b9870e2cac): created successfully Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60373bfe-e941-4544-bf5d-ba854b22e1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (9bf231bc-46f5-441e-a955-521f979acc27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:35:59 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5aa93bf5-bd4e-4f63-b519-4ed038dd1ab2 tempest-CreateVolumesFromSnapshotTest-289206986 None] Created volume successfully. Sep 07 02:35:59 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae" returned: 0 in 0.439s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:59 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae Sep 07 02:35:59 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:59 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:59 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD Sep 07 02:35:59 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:59 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a 1073741824" returned: 0 in 0.514s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:59 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-11b9ddd5-5f95-4903-8a75-ba2589d13bae" returned: 0 in 0.275s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-quobyte-11b9ddd5-5f95-4903-8a75-ba2589d13bae" released by "delete_volume" :: held 0.762s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:35:59 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a Sep 07 02:35:59 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Created reservations ['ae3adfb6-cb61-44b9-85d4-6f30f69d88e2', 'd36fc335-3520-4ff3-81c5-2678c694e52f', '33197886-19ac-4269-a4e4-3d4420c5a8aa', '015754e8-5382-483c-a5d9-9130bd133aa5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:35:59 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] e476671d-6835-4f81-a84d-9d4f6d31b486 was raw, converting to qcow2 {{(pid=87313) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 02:35:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:00 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e Sep 07 02:36:00 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:00 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:00 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:00 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a" returned: 0 in 0.276s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.488s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1519976432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f3b0cf-1847-4ee1-b30d-5664a6348e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:56Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Creating volume c7f3b0cf-1847-4ee1-b30d-5664a6348e76 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:00 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c36ea4a-1146-405d-a586-1173b5cb04d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a62a4b2-8448-4e2d-a665-4a027616699a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a33e302-6d7f-4c88-b874-7b11447515f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:00 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76 1073741824 Sep 07 02:36:00 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume volume-3a62a4b2-8448-4e2d-a665-4a027616699a (3a62a4b2-8448-4e2d-a665-4a027616699a): created successfully Sep 07 02:36:00 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a33e302-6d7f-4c88-b874-7b11447515f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (fdec3237-d2d1-4cb8-b4e9-c8178bd691b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:00 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b6b1d175-c2e1-442d-8172-239416f6260e tempest-CreateVolumesFromSnapshotTest-289206986 None] Created volume successfully. Sep 07 02:36:00 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.293s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:00 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Deleted volume successfully. Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-35555c7c-bb5b-4e02-b49b-7d5eafdf4f87 tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-11b9ddd5-5f95-4903-8a75-ba2589d13bae-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:00 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e" returned: 0 in 0.511s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e476671d-6835-4f81-a84d-9d4f6d31b486_lo24_sb7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:36:00 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:00 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e 1G Sep 07 02:36:00 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:00 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76 1073741824" returned: 0 in 0.507s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=172,cinder:SELECT=137,cinder:DELETE=18,cinder:INSERT=40 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:00 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76 Sep 07 02:36:00 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:00 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e 1G" returned: 0 in 0.322s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Downloaded image e476671d-6835-4f81-a84d-9d4f6d31b486 ((None, [{'url': 'file:///opt/stack/data/glance/images/e476671d-6835-4f81-a84d-9d4f6d31b486', 'metadata': {}}])) to volume 08713a19-9fd9-4d84-b374-8e979f4ada3e successfully. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Temporary image e476671d-6835-4f81-a84d-9d4f6d31b486 for user 0a5895b2bbf44351ba67dc24ce96017f is deleted. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Marking volume 08713a19-9fd9-4d84-b374-8e979f4ada3e as bootable. {{(pid=87313) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Copying metadata from image e476671d-6835-4f81-a84d-9d4f6d31b486 to 08713a19-9fd9-4d84-b374-8e979f4ada3e. {{(pid=87313) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Creating volume glance metadata for volume 08713a19-9fd9-4d84-b374-8e979f4ada3e backed by image e476671d-6835-4f81-a84d-9d4f6d31b486 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e476671d-6835-4f81-a84d-9d4f6d31b486', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7eebcafdb810bec9b8b3368b9837b63f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87313) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2f82f3-3bd7-4703-bc8b-0b47c948a530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08713a19-9fd9-4d84-b374-8e979f4ada3e', 'volume_size': 1, 'image_id': 'e476671d-6835-4f81-a84d-9d4f6d31b486', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e476671d-6835-4f81-a84d-9d4f6d31b486', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7eebcafdb810bec9b8b3368b9837b63f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de871f2ca8e349cd95c773fc1c513274', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '07760a1a15fb8123b451e43f3bbf9f1c6f7a12ce3ab759ac9c7c36689b1ad2baad313cfca1a4cc753f11bf7916f7b352675b29fbece53695758892e22b8d1ffb', 'id': 'e476671d-6835-4f81-a84d-9d4f6d31b486', 'created_at': datetime.datetime(2026, 9, 7, 0, 35, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 35, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e476671d-6835-4f81-a84d-9d4f6d31b486/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125ffb1a-f13a-4fe5-ac9e-0f9eec9538da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:00 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Volume volume-08713a19-9fd9-4d84-b374-8e979f4ada3e (08713a19-9fd9-4d84-b374-8e979f4ada3e): created successfully Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125ffb1a-f13a-4fe5-ac9e-0f9eec9538da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Flow 'volume_create_manager' (b58fc42d-ee1c-4c52-9d07-a004c575487f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:00 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-314a8d07-54f7-47ec-bb78-a0bd00b4f094 tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Created volume successfully. Sep 07 02:36:00 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76" returned: 0 in 0.275s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.971s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1499022780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a770f8c-6dd4-44bc-9620-15fcfdef14c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:57Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Creating volume 9a770f8c-6dd4-44bc-9620-15fcfdef14c8 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:01 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76d1ab9-c583-46f2-92a3-94b723e6b5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:01 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8 1073741824 Sep 07 02:36:01 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5317e626-f50b-4d57-ae2f-7925c2f5b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:01 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76 (c7f3b0cf-1847-4ee1-b30d-5664a6348e76): created successfully Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5317e626-f50b-4d57-ae2f-7925c2f5b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (4de82412-42f6-44eb-82f9-9d3f71ccc99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6aeec4fb-c59e-4a64-a8f2-3b61c280b49a tempest-CreateVolumesFromSnapshotTest-289206986 None] Created volume successfully. Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "cinder-825300ab-22f7-4de5-8d73-4e725e8994cd-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-825300ab-22f7-4de5-8d73-4e725e8994cd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "cinder-quobyte-825300ab-22f7-4de5-8d73-4e725e8994cd" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-quobyte-825300ab-22f7-4de5-8d73-4e725e8994cd" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85c05ec-b9be-4f0f-af9a-15bb6a1a374f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:01 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd Sep 07 02:36:01 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Acquiring lock "cinder-08713a19-9fd9-4d84-b374-8e979f4ada3e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Lock "cinder-08713a19-9fd9-4d84-b374-8e979f4ada3e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Acquiring lock "cinder-quobyte-08713a19-9fd9-4d84-b374-8e979f4ada3e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Lock "cinder-quobyte-08713a19-9fd9-4d84-b374-8e979f4ada3e" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e585e1f1-9bd5-485c-9d71-d91834ab40b4]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:01 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8 1073741824" returned: 0 in 0.549s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:01 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8 Sep 07 02:36:01 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:01 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd" returned: 0 in 0.412s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:01 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd Sep 07 02:36:01 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:01 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e Sep 07 02:36:01 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:01 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8" returned: 0 in 0.281s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.496s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1907678124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1abc34-5f8c-46c9-8f8c-54b5697d5518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63eef7c3976e4970837657a0d5cc73fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:35:57Z,use_quota=True,user_id='fa88abbe6f1f4145b824d7440248b22c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Creating volume af1abc34-5f8c-46c9-8f8c-54b5697d5518 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:01 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:01 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-825300ab-22f7-4de5-8d73-4e725e8994cd" returned: 0 in 0.273s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:01 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518 1073741824 Sep 07 02:36:01 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdaa9366-92a3-4d25-81ea-a1814c6a5484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c391b6e-8848-45d2-83c4-70307c3e0be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-quobyte-825300ab-22f7-4de5-8d73-4e725e8994cd" released by "delete_volume" :: held 0.746s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:01 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e" returned: 0 in 0.409s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:01 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8 (9a770f8c-6dd4-44bc-9620-15fcfdef14c8): created successfully Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c391b6e-8848-45d2-83c4-70307c3e0be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (cd942311-da35-4daa-a97c-cac45cc64cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:01 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e Sep 07 02:36:01 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b20b3995-2e51-432e-9d2a-132f6c6e1df3 tempest-CreateVolumesFromSnapshotTest-289206986 None] Created volume successfully. Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Created reservations ['8a4f1e6f-b15c-4ea6-8749-b5488c640e46', 'd83bf04a-36c5-4fd5-82e3-912fed520e40', '9b603de5-f83a-48b3-8975-526fa361e364', '1486d25c-471e-4ed7-8d96-7f87fb6449c0'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:02 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:02 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:02 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-08713a19-9fd9-4d84-b374-8e979f4ada3e" returned: 0 in 0.305s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Lock "cinder-quobyte-08713a19-9fd9-4d84-b374-8e979f4ada3e" released by "delete_volume" :: held 0.758s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Created reservations ['8bb61a2b-7d6d-4c9d-a40c-8b2b0c9b626a', '18cb7f3a-714b-41e4-ae1b-134c2499b804', '6a7f0408-6615-4b99-a6c5-b406ca5fa500', '0bad26af-6573-46e8-b5fe-27dd604ac241'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:02 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518 1073741824" returned: 0 in 0.468s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:02 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.332s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:02 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:02 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Deleted volume successfully. Sep 07 02:36:02 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518 Sep 07 02:36:02 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0ff53e0d-e7be-46ad-a1b7-d36518653c6b tempest-CreateVolumesFromImageTest-333397335 None] Lock "cinder-825300ab-22f7-4de5-8d73-4e725e8994cd-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:02 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518" returned: 0 in 0.300s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.696s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Acquiring lock "cinder-quobyte-8072d0c6-25d2-4650-b3cf-ff4b3b65292c-bd61f1f3-c254-4368-9376-cc52cac39d14" by "_create_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:02 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4ffcf7-c4a6-4b53-926e-8f37ec988fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db4f1c4-9fe4-41fd-a08b-b0ff30384400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-8072d0c6-25d2-4650-b3cf-ff4b3b65292c-bd61f1f3-c254-4368-9376-cc52cac39d14" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Creating volume bd61f1f3-c254-4368-9376-cc52cac39d14 from snapshot 8072d0c6-25d2-4650-b3cf-ff4b3b65292c {{(pid=87313) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Acquiring lock "cinder-quobyte-bd61f1f3-c254-4368-9376-cc52cac39d14" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.400s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Deleted volume successfully. Sep 07 02:36:02 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Volume volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518 (af1abc34-5f8c-46c9-8f8c-54b5697d5518): created successfully Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db4f1c4-9fe4-41fd-a08b-b0ff30384400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Flow 'volume_create_manager' (f1f35899-91c7-4f49-8e51-038b2a725892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-bd61f1f3-c254-4368-9376-cc52cac39d14" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] snapshot: 8072d0c6-25d2-4650-b3cf-ff4b3b65292c, volume: bd61f1f3-c254-4368-9376-cc52cac39d14, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c5bfa38b-0691-4644-8dc1-d4492e47a59a tempest-CreateVolumesFromSnapshotTest-289206986 None] Created volume successfully. Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9439f6dc-ad2c-4b12-96cb-9a897216fe0d tempest-VolumeAndVolumeTypeFromImageTest-335350530 None] Lock "cinder-08713a19-9fd9-4d84-b374-8e979f4ada3e-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0181b6-c113-4894-94f1-6a111bccfca8]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-af1abc34-5f8c-46c9-8f8c-54b5697d5518-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-af1abc34-5f8c-46c9-8f8c-54b5697d5518-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:03 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-quobyte-af1abc34-5f8c-46c9-8f8c-54b5697d5518" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:03 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-af1abc34-5f8c-46c9-8f8c-54b5697d5518" acquired by "delete_volume" :: waited 0.039s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8c4b69-f08f-42c8-b172-e9b89c716ef8]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:03 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518 Sep 07 02:36:03 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:03 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c" returned: 0 in 0.511s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[26222a75-e011-4ac2-aa3c-3300d034185d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:03 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a Sep 07 02:36:03 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:03 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518" returned: 0 in 0.521s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:03 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518 Sep 07 02:36:03 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:03 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" returned: 0 in 0.483s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:36:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14 not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:04 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14 Sep 07 02:36:04 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:04 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-af1abc34-5f8c-46c9-8f8c-54b5697d5518" returned: 0 in 0.414s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-af1abc34-5f8c-46c9-8f8c-54b5697d5518" released by "delete_volume" :: held 1.000s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Created reservations ['cc15bd9f-ef60-4e37-ae39-a9932d964f06', '046c7a37-6690-4e9c-b3a0-e05179f99762', '189a4772-ab57-4287-b4e9-4943b9a4e83d', '7107037f-6ae3-4c30-9925-82b48257ef41'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:04 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:04 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:04 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.404s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:04 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Deleted volume successfully. Sep 07 02:36:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c5071a4-9cd5-4b70-8850-eabdd6020e4d tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-af1abc34-5f8c-46c9-8f8c-54b5697d5518-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-9a770f8c-6dd4-44bc-9620-15fcfdef14c8-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-9a770f8c-6dd4-44bc-9620-15fcfdef14c8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-quobyte-9a770f8c-6dd4-44bc-9620-15fcfdef14c8" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-9a770f8c-6dd4-44bc-9620-15fcfdef14c8" acquired by "delete_volume" :: waited 0.048s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:05 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3efd84-6719-4ba1-be4b-368d5f6f577c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:06 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8 Sep 07 02:36:06 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:06 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8" returned: 0 in 1.058s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:07 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8 Sep 07 02:36:07 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:07 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9a770f8c-6dd4-44bc-9620-15fcfdef14c8" returned: 0 in 0.811s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-9a770f8c-6dd4-44bc-9620-15fcfdef14c8" released by "delete_volume" :: held 1.972s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:07 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Created reservations ['72488ff4-7640-4e66-9553-4bbf6060ec05', 'ba948524-4841-4bce-9825-634dc3deb9ee', '902293bb-af7d-4e4e-acbd-2c89fab0f020', 'e36510c8-f746-4d7b-8003-5b73e81725ae'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:08 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:08 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-c7f3b0cf-1847-4ee1-b30d-5664a6348e76-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-c7f3b0cf-1847-4ee1-b30d-5664a6348e76-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-quobyte-c7f3b0cf-1847-4ee1-b30d-5664a6348e76" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-c7f3b0cf-1847-4ee1-b30d-5664a6348e76" acquired by "delete_volume" :: waited 0.043s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[637b9a73-01ad-422b-acba-1c856f55f2bd]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:08 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:08 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76 Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.778s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:08 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:08 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:08 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Deleted volume successfully. Sep 07 02:36:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-9b3d6c14-b9cd-4021-8c85-9a42b99ad79b tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-9a770f8c-6dd4-44bc-9620-15fcfdef14c8-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:09 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76" returned: 0 in 0.832s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:09 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76 Sep 07 02:36:09 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:10 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c7f3b0cf-1847-4ee1-b30d-5664a6348e76" returned: 0 in 0.651s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-c7f3b0cf-1847-4ee1-b30d-5664a6348e76" released by "delete_volume" :: held 1.603s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:10 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14" returned: 0 in 6.173s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:36:10 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Converted 1024.00 MB image at 165.84 MB/s Sep 07 02:36:10 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14 is being set with open permissions: ugo+rw Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Created reservations ['aab62843-9681-4a08-8b5a-c198cbcb351d', 'd4a72cd1-65eb-4884-9f54-49e2b31a1068', '7acaa7a3-487e-4817-98b6-a7b4e4368128', '65f6f82d-e127-4ff9-9a46-8dbd083513bd'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:10 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14 Sep 07 02:36:10 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:10 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:10 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:10 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14" returned: 0 in 0.316s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-bd61f1f3-c254-4368-9376-cc52cac39d14" released by "_copy_volume_from_snapshot" :: held 7.632s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-8072d0c6-25d2-4650-b3cf-ff4b3b65292c-bd61f1f3-c254-4368-9376-cc52cac39d14" released by "_create_volume_from_snapshot" :: held 7.754s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.814s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b54f217-4f63-4cdd-9ddd-3efd9ad96416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd61f1f3-c254-4368-9376-cc52cac39d14', 'volume_size': 1, 'snapshot_id': '8072d0c6-25d2-4650-b3cf-ff4b3b65292c'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:10 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72558fc9-1c0b-4a82-943b-2ec4851c6a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.309s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Deleted volume successfully. Sep 07 02:36:10 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Volume volume-bd61f1f3-c254-4368-9376-cc52cac39d14 (bd61f1f3-c254-4368-9376-cc52cac39d14): created successfully Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72558fc9-1c0b-4a82-943b-2ec4851c6a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Flow 'volume_create_manager' (e407a970-514d-4a3c-85cd-861a7ec0b60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-29b083cd-0bff-4e29-ac74-45bb10dd7f46 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-c7f3b0cf-1847-4ee1-b30d-5664a6348e76-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-14c0f265-2aed-4533-8340-41ad71f5a1da tempest-VolumeDependencyTests-953298579 None] Created volume successfully. Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-3a62a4b2-8448-4e2d-a665-4a027616699a-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-3a62a4b2-8448-4e2d-a665-4a027616699a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-quobyte-3a62a4b2-8448-4e2d-a665-4a027616699a" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-3a62a4b2-8448-4e2d-a665-4a027616699a" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbf5250-32e6-4cec-9417-498c8727b3ab]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:11 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a Sep 07 02:36:11 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Acquiring lock "cinder-8072d0c6-25d2-4650-b3cf-ff4b3b65292c-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Lock "cinder-8072d0c6-25d2-4650-b3cf-ff4b3b65292c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Acquiring lock "cinder-quobyte-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Acquiring lock "cinder-quobyte-8072d0c6-25d2-4650-b3cf-ff4b3b65292c" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-8072d0c6-25d2-4650-b3cf-ff4b3b65292c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Deleting offline snapshot 8072d0c6-25d2-4650-b3cf-ff4b3b65292c of volume d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] snapshot_file for this snap is: volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef05cc-2e99-4d39-bbaf-2bc33e85a5e4]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (4d27e750-bef6-4b4b-8002-b7bf644b2f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062a2143-2bff-4d48-b51e-dd81ab811666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062a2143-2bff-4d48-b51e-dd81ab811666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1764577423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:11Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:11 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c Sep 07 02:36:11 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffcabbe-565a-4d57-a5c1-32fa3e4ea54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:11 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffcabbe-565a-4d57-a5c1-32fa3e4ea54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859243ed-a412-45e8-b0e6-0e8391033aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859243ed-a412-45e8-b0e6-0e8391033aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d', 'volume_name': 'volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b7c51a-52e8-459d-aaf8-52914eb3240b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b7c51a-52e8-459d-aaf8-52914eb3240b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da57c6da-2b63-43db-a309-40d28ac8c79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:11 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume 03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d', 'volume_size': 1} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1764577423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:11Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Creating volume 03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:11 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a" returned: 0 in 0.533s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:11 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d 1073741824 Sep 07 02:36:11 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:11 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a Sep 07 02:36:11 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:11 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:11 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c" returned: 0 in 0.476s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-3a62a4b2-8448-4e2d-a665-4a027616699a" returned: 0 in 0.294s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d11665a-35bb-498d-9e8f-a24ae9129c23]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:11 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-3a62a4b2-8448-4e2d-a665-4a027616699a" released by "delete_volume" :: held 0.902s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Created reservations ['64f7acba-fca4-46a4-8ca6-244868f7226b', 'e5887ec3-6a71-4fb2-8d78-c7462fab853d', 'b3065f3e-aeba-4628-8269-ff1cab538bda', '157dcfff-a121-4ead-998f-e768abf14998'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:12 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a Sep 07 02:36:12 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:12 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:12 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-b751f371-460f-40f4-8a21-99b9870e2cac-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-b751f371-460f-40f4-8a21-99b9870e2cac-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:12 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d 1073741824" returned: 0 in 0.681s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-quobyte-b751f371-460f-40f4-8a21-99b9870e2cac" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-b751f371-460f-40f4-8a21-99b9870e2cac" acquired by "delete_volume" :: waited 0.040s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a8c6c8-a2c8-4627-b679-b609a6a653d1]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:12 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d Sep 07 02:36:12 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:12 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.370s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:12 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Deleted volume successfully. Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-e751f1a4-69f1-47c7-b43a-a7112e5394ae tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-3a62a4b2-8448-4e2d-a665-4a027616699a-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:12 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac Sep 07 02:36:12 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:12 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d" returned: 0 in 0.316s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:12 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" returned: 0 in 0.790s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da57c6da-2b63-43db-a309-40d28ac8c79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edff8e9b-528c-4363-a1f2-6ee652cb9ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:12 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c Sep 07 02:36:12 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:12 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d (03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d): created successfully Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edff8e9b-528c-4363-a1f2-6ee652cb9ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (4d27e750-bef6-4b4b-8002-b7bf644b2f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:12 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-311aae4e-74a1-49fa-81da-c3a289c464e5 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created volume successfully. Sep 07 02:36:12 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac" returned: 0 in 0.575s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:13 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac Sep 07 02:36:13 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:13 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c" returned: 0 in 0.496s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:13 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c Sep 07 02:36:13 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:13 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b751f371-460f-40f4-8a21-99b9870e2cac" returned: 0 in 0.356s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-b751f371-460f-40f4-8a21-99b9870e2cac" released by "delete_volume" :: held 1.037s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Created reservations ['ed53a8e9-8408-44a5-b82b-2c3de2cc5b13', '804ee0eb-bf3f-4f1e-9355-b026018a4f77', 'ed21fe93-6869-48c7-846a-a25c0c5a01dc', '032f1ede-70fb-44cc-9687-87923214ea74'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:13 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a.8072d0c6-25d2-4650-b3cf-ff4b3b65292c" returned: 0 in 0.309s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-8072d0c6-25d2-4650-b3cf-ff4b3b65292c" released by "_delete_snapshot" :: held 2.210s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" released by "delete_snapshot" :: held 2.251s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:13 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:13 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Created reservations ['5b9413b3-3105-4c3b-94ce-2ceee749695b', '4bfaad8a-10f4-4081-aeae-6fe63caa7764', '3c53864c-8450-4134-bb54-53ea136a6953', '9b6bc7bb-3865-417f-afc8-5e2e6fe5791e'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Delete snapshot completed successfully. Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fffbe71c-8327-4693-981b-b2d172a8ac16 tempest-VolumeDependencyTests-953298579 None] Lock "cinder-8072d0c6-25d2-4650-b3cf-ff4b3b65292c-delete_snapshot" released by "delete_snapshot" :: held 2.518s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:13 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.306s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Deleted volume successfully. Sep 07 02:36:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a6e2f738-1bc2-4ef9-9306-f6219840f515 tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-b751f371-460f-40f4-8a21-99b9870e2cac-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (94421648-2803-4caf-889e-f07147f1641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f86108-ea5c-4c84-be33-ae9fb700659a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f86108-ea5c-4c84-be33-ae9fb700659a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046281655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89d3106-7220-4614-b715-271dae0c0915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:14Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b930c96-8c66-4f65-a980-9612d5181752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b930c96-8c66-4f65-a980-9612d5181752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074fccd8-10b8-4414-8e6f-b8a263f2d435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074fccd8-10b8-4414-8e6f-b8a263f2d435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89d3106-7220-4614-b715-271dae0c0915', 'volume_name': 'volume-a89d3106-7220-4614-b715-271dae0c0915', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d721888-58fb-406c-bbf1-d24be4b4fa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d721888-58fb-406c-bbf1-d24be4b4fa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907665d1-3851-46cd-b0db-754a06e755b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:14 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume a89d3106-7220-4614-b715-271dae0c0915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89d3106-7220-4614-b715-271dae0c0915', 'volume_size': 1} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046281655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89d3106-7220-4614-b715-271dae0c0915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:14Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Creating volume a89d3106-7220-4614-b715-271dae0c0915 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:14 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:14 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915 1073741824 Sep 07 02:36:14 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-1d2df7fe-3535-4dc6-8726-2e003c843102-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-1d2df7fe-3535-4dc6-8726-2e003c843102-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-quobyte-1a214368-808c-4292-8900-b672abf6e56f" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-1a214368-808c-4292-8900-b672abf6e56f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-quobyte-1d2df7fe-3535-4dc6-8726-2e003c843102" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-1d2df7fe-3535-4dc6-8726-2e003c843102" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Deleting offline snapshot 1d2df7fe-3535-4dc6-8726-2e003c843102 of volume 1a214368-808c-4292-8900-b672abf6e56f {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] snapshot_file for this snap is: volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[56217e4e-59fa-47cc-8426-6540ff156a9c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Acquiring lock "cinder-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (b3bf6a76-d17c-4768-a2a2-9573a34cca1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:14 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6ccb3f-319c-4f90-9d20-c5582436d497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:14 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Lock "cinder-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6ccb3f-319c-4f90-9d20-c5582436d497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-208862194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:15Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd490f13-1406-43bc-8a76-71a3ccf0b3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd490f13-1406-43bc-8a76-71a3ccf0b3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d4619e-6a46-4f48-bcf8-0092f0d0a16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d4619e-6a46-4f48-bcf8-0092f0d0a16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68', 'volume_name': 'volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3452a881-0c19-44a0-b0cb-30e91698d828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3452a881-0c19-44a0-b0cb-30e91698d828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9c4ed9-c4c2-4383-88eb-431be322c968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:14 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume 4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68', 'volume_size': 1} Sep 07 02:36:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Acquiring lock "cinder-quobyte-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:15 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915 1073741824" returned: 0 in 0.784s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" acquired by "delete_volume" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafefe9a-d1b2-4779-bb0d-dc08b820fa91]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:15 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915 Sep 07 02:36:15 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (6d661390-26f3-4001-bb53-83f958c360fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9069f9a-25b6-4af0-b60f-810deee67cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:15 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9069f9a-25b6-4af0-b60f-810deee67cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1295879314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd55538-5f43-410c-8f82-d7961ffa3e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:15Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce93621-1546-4a21-b479-9f650de0e246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce93621-1546-4a21-b479-9f650de0e246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:15 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a Sep 07 02:36:15 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d7c52b-2888-47f4-80a5-98d76768e40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d7c52b-2888-47f4-80a5-98d76768e40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd55538-5f43-410c-8f82-d7961ffa3e7a', 'volume_name': 'volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da6b1b1-c338-4c2b-9b81-ed3b26962a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da6b1b1-c338-4c2b-9b81-ed3b26962a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad65e410-7d46-41de-9e75-29fc50aac833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:15 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume bbd55538-5f43-410c-8f82-d7961ffa3e7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a', 'volume_size': 1} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102" returned: 0 in 0.670s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a214368-808c-4292-8900-b672abf6e56f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[694c5c14-d600-4867-8c42-f718af48437c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:15 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915" returned: 0 in 0.373s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.570s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-208862194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:15Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Creating volume 4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:15 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907665d1-3851-46cd-b0db-754a06e755b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89d3106-7220-4614-b715-271dae0c0915', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cf8850-dd4b-403f-b099-447c8e663529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:15 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68 1073741824 Sep 07 02:36:15 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:15 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume volume-a89d3106-7220-4614-b715-271dae0c0915 (a89d3106-7220-4614-b715-271dae0c0915): created successfully Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cf8850-dd4b-403f-b099-447c8e663529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (94421648-2803-4caf-889e-f07147f1641c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:15 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-22f8834a-63a7-4754-96c1-971d8970584c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created volume successfully. Sep 07 02:36:15 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f Sep 07 02:36:15 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:15 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" returned: 0 in 0.696s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:15 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a Sep 07 02:36:15 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (1fe1925d-c9aa-4c29-a94e-08ce3b8f2395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e3aa44-4c14-4270-ad6a-9094151cdd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e3aa44-4c14-4270-ad6a-9094151cdd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-682784472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e38b1b3-4274-4e9d-a810-818b8bd32e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:16Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3834fc-cfff-43d1-95f9-71f1e5f46961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3834fc-cfff-43d1-95f9-71f1e5f46961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea16936-adf9-4249-82ef-e0e8a58c66f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea16936-adf9-4249-82ef-e0e8a58c66f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e38b1b3-4274-4e9d-a810-818b8bd32e02', 'volume_name': 'volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:15 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79679c58-a68e-49d9-a7f4-a9b3c1d2d44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79679c58-a68e-49d9-a7f4-a9b3c1d2d44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e7159a-f9ca-4ead-9d34-023c3dc39b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:16 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume 5e38b1b3-4274-4e9d-a810-818b8bd32e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02', 'volume_size': 1} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:16 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f" returned: 0 in 0.740s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:16 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 Sep 07 02:36:16 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:16 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" returned: 0 in 0.549s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:16 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (069e61b3-7d75-454f-b701-a5a0f9b67fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306d5474-0bdc-4e61-bb41-a4c8ba9cc575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68 1073741824" returned: 0 in 0.858s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a" released by "delete_volume" :: held 1.362s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306d5474-0bdc-4e61-bb41-a4c8ba9cc575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1233651391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eabb38-90a8-4ae0-a382-8fad7ec0725d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:16Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45be5ccf-09c1-48e9-9046-de9a58680b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45be5ccf-09c1-48e9-9046-de9a58680b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82aea200-39fa-45e2-9101-2e47da0d30ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82aea200-39fa-45e2-9101-2e47da0d30ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98eabb38-90a8-4ae0-a382-8fad7ec0725d', 'volume_name': 'volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe418cc-1b48-4cf6-91bc-c61e22031197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe418cc-1b48-4cf6-91bc-c61e22031197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78dc13a-35f8-4170-b603-0cd023766791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:16 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume 98eabb38-90a8-4ae0-a382-8fad7ec0725d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d', 'volume_size': 1} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:16 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102" returned: 0 in 0.457s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:16 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68 Sep 07 02:36:16 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Created reservations ['41df044f-45bb-477d-880b-472d541bb852', 'a066a343-6834-4c48-b311-c388f4f8a51d', '9315ade1-3ea7-4dbe-bb90-087922834557', '0caa97a3-938c-46ca-b5b0-6e385c9950a5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:16 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102 Sep 07 02:36:16 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:16 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:16 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:16 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f.1d2df7fe-3535-4dc6-8726-2e003c843102" returned: 0 in 0.279s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:16 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68" returned: 0 in 0.342s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-1d2df7fe-3535-4dc6-8726-2e003c843102" released by "_delete_snapshot" :: held 2.313s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1295879314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd55538-5f43-410c-8f82-d7961ffa3e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:15Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Creating volume bbd55538-5f43-410c-8f82-d7961ffa3e7a {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:16 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9c4ed9-c4c2-4383-88eb-431be322c968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05b579b-1207-47c9-ae04-7968b458bbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:16 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a 1073741824 Sep 07 02:36:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-1a214368-808c-4292-8900-b672abf6e56f" released by "delete_snapshot" :: held 2.417s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:16 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:17 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68 (4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68): created successfully Sep 07 02:36:17 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05b579b-1207-47c9-ae04-7968b458bbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (b3bf6a76-d17c-4768-a2a2-9573a34cca1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.315s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:17 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Deleted volume successfully. Sep 07 02:36:17 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5d295255-ce6c-4696-8d40-1443f4bdf670 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created volume successfully. Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b97699ff-98c5-4ed5-b7dd-77d754bbb109 tempest-VolumeDependencyTests-953298579 None] Lock "cinder-d9c18d7e-85a5-4f0e-8ffe-515bd3781f1a-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Created reservations ['90f22cc3-5e35-40cd-8dfb-6b15bedf51aa', '360ebc62-29cc-4bc9-a519-2c83a3113d95', '9e444507-f8bd-49e6-8fd3-c11969002554', '350a6b80-4883-4891-b0bc-66a1a4141aba'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Acquiring lock "cinder-bd61f1f3-c254-4368-9376-cc52cac39d14-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Lock "cinder-bd61f1f3-c254-4368-9376-cc52cac39d14-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Acquiring lock "cinder-quobyte-bd61f1f3-c254-4368-9376-cc52cac39d14" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:17 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Delete snapshot completed successfully. Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5a9dfd80-87b4-4cbf-83c3-3b312898afba tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-1d2df7fe-3535-4dc6-8726-2e003c843102-delete_snapshot" released by "delete_snapshot" :: held 2.758s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-bd61f1f3-c254-4368-9376-cc52cac39d14" acquired by "delete_volume" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7938be0-e8f2-489b-af6b-13ada1ed3735]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:17 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14 Sep 07 02:36:17 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:17 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a 1073741824" returned: 0 in 0.651s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:17 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a Sep 07 02:36:17 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:17 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14" returned: 0 in 0.409s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-1a214368-808c-4292-8900-b672abf6e56f-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:17 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14 Sep 07 02:36:17 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-1a214368-808c-4292-8900-b672abf6e56f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "cinder-quobyte-1a214368-808c-4292-8900-b672abf6e56f" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-1a214368-808c-4292-8900-b672abf6e56f" acquired by "delete_volume" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:17 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a" returned: 0 in 0.343s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.959s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-682784472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e38b1b3-4274-4e9d-a810-818b8bd32e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:16Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Creating volume 5e38b1b3-4274-4e9d-a810-818b8bd32e02 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:17 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d72ded-2460-49ef-818d-2c451e4ac663]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:18 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02 1073741824 Sep 07 02:36:18 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad65e410-7d46-41de-9e75-29fc50aac833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10413823-46cc-456d-92e9-aaf3eb005735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:18 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a (bbd55538-5f43-410c-8f82-d7961ffa3e7a): created successfully Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10413823-46cc-456d-92e9-aaf3eb005735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (6d661390-26f3-4001-bb53-83f958c360fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:18 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a841ca6f-d083-46e5-b8a2-90438c80f65a tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created volume successfully. Sep 07 02:36:18 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bd61f1f3-c254-4368-9376-cc52cac39d14" returned: 0 in 0.390s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Lock "cinder-quobyte-bd61f1f3-c254-4368-9376-cc52cac39d14" released by "delete_volume" :: held 0.858s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:18 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f Sep 07 02:36:18 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Created reservations ['655fa314-da89-4e2f-bf92-d54c5d5f7729', '7574798b-4575-4f03-865e-49ad30815360', 'd9758377-b962-4302-833b-4421e3a51a17', '65605665-7021-49bb-9f7f-6231bb74bdfb'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:18 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:18 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f" returned: 0 in 0.638s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:18 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:18 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f Sep 07 02:36:18 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:18 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:18 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02 1073741824" returned: 0 in 0.768s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.388s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:18 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Deleted volume successfully. Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fe574cf7-bc7c-42e6-9a97-840381fa62bd tempest-VolumeDependencyTests-953298579 None] Lock "cinder-bd61f1f3-c254-4368-9376-cc52cac39d14-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:18 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02 Sep 07 02:36:18 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:19 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a214368-808c-4292-8900-b672abf6e56f" returned: 0 in 0.461s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-quobyte-1a214368-808c-4292-8900-b672abf6e56f" released by "delete_volume" :: held 1.225s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Created reservations ['11bfd939-aa65-4d6a-9ea6-110da257c4d2', '74d45b50-d3ce-483d-b873-39d6fd51cbdd', 'c305781a-afca-48aa-8dec-deb8be351a43', 'e56dfef9-73da-4e78-ae5b-549424545743'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:19 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02" returned: 0 in 0.379s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.722s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1233651391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eabb38-90a8-4ae0-a382-8fad7ec0725d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a16b7c366074ff8b5ed8536e998b7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:16Z,use_quota=True,user_id='d62eb6569e6e47f2887308f7ef7c993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Creating volume 98eabb38-90a8-4ae0-a382-8fad7ec0725d {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:19 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e7159a-f9ca-4ead-9d34-023c3dc39b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc4605d-f7e1-4483-a676-9c4ef820dd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:19 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d 1073741824 Sep 07 02:36:19 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:19 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02 (5e38b1b3-4274-4e9d-a810-818b8bd32e02): created successfully Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc4605d-f7e1-4483-a676-9c4ef820dd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (1fe1925d-c9aa-4c29-a94e-08ce3b8f2395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:19 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7347aec2-2883-4902-8db1-64f00c7c521c tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created volume successfully. Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:19 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:19 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:19 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.291s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:19 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Deleted volume successfully. Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2173450e-9fec-4251-b373-75008e0c562f tempest-CreateVolumesFromSnapshotTest-289206986 None] Lock "cinder-1a214368-808c-4292-8900-b672abf6e56f-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:19 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d 1073741824" returned: 0 in 0.593s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:19 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d Sep 07 02:36:19 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:20 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d" returned: 0 in 0.347s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78dc13a-35f8-4170-b603-0cd023766791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f94ed7b-e336-4c0b-9854-9de43ffa218b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:20 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Volume volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d (98eabb38-90a8-4ae0-a382-8fad7ec0725d): created successfully Sep 07 02:36:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f94ed7b-e336-4c0b-9854-9de43ffa218b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:20 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Flow 'volume_create_manager' (069e61b3-7d75-454f-b701-a5a0f9b67fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:20 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d75bea09-ef8c-466f-964d-b3116f61d626 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created volume successfully. Sep 07 02:36:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-98eabb38-90a8-4ae0-a382-8fad7ec0725d-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-98eabb38-90a8-4ae0-a382-8fad7ec0725d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-quobyte-98eabb38-90a8-4ae0-a382-8fad7ec0725d" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-98eabb38-90a8-4ae0-a382-8fad7ec0725d" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:21 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8e966b-20e9-41b3-9cb8-45bbacb150cb]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:21 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d Sep 07 02:36:21 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:21 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d" returned: 0 in 0.445s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:21 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d Sep 07 02:36:21 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:21 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-98eabb38-90a8-4ae0-a382-8fad7ec0725d" returned: 0 in 0.386s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-98eabb38-90a8-4ae0-a382-8fad7ec0725d" released by "delete_volume" :: held 0.893s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created reservations ['1a75b1c7-fb27-4766-bd05-135e41398f07', '77d55950-315e-49f1-bfc7-b3059242a50a', 'c79c6c3c-daf7-47a8-83a3-fc1a38222730', '54b126b1-9250-47b5-826e-b191a53beaea'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:22 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:22 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-5e38b1b3-4274-4e9d-a810-818b8bd32e02-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-5e38b1b3-4274-4e9d-a810-818b8bd32e02-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-quobyte-5e38b1b3-4274-4e9d-a810-818b8bd32e02" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-5e38b1b3-4274-4e9d-a810-818b8bd32e02" acquired by "delete_volume" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[18595122-0bb7-4aa8-8e77-c6d3e472d78e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:22 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.356s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:22 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Deleted volume successfully. Sep 07 02:36:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-591b6194-5b90-463d-b66d-fabdfc817105 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-98eabb38-90a8-4ae0-a382-8fad7ec0725d-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:22 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02 Sep 07 02:36:22 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:23 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02" returned: 0 in 0.483s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:23 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02 Sep 07 02:36:23 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:23 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5e38b1b3-4274-4e9d-a810-818b8bd32e02" returned: 0 in 0.403s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-5e38b1b3-4274-4e9d-a810-818b8bd32e02" released by "delete_volume" :: held 0.945s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created reservations ['31a26785-d32b-4273-b396-09db39a790c6', '6ee0f541-72da-4938-beee-9b5876f7644d', '89fa3f02-547d-4555-b054-eaa4ffdb8b9d', 'e928d939-6cde-4cfa-a57a-a1a19ecf7a1d'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:23 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:23 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:23 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.315s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:23 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Deleted volume successfully. Sep 07 02:36:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6c32cb-2d43-44cd-9930-2879db8fd288 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-5e38b1b3-4274-4e9d-a810-818b8bd32e02-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-bbd55538-5f43-410c-8f82-d7961ffa3e7a-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-bbd55538-5f43-410c-8f82-d7961ffa3e7a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-quobyte-bbd55538-5f43-410c-8f82-d7961ffa3e7a" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-bbd55538-5f43-410c-8f82-d7961ffa3e7a" acquired by "delete_volume" :: waited 0.037s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:24 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcad7e6d-9d49-405b-9b4b-b13e9f0f443f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:25 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a Sep 07 02:36:25 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:25 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a" returned: 0 in 0.511s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:25 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a Sep 07 02:36:25 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:25 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bbd55538-5f43-410c-8f82-d7961ffa3e7a" returned: 0 in 0.389s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:25 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-bbd55538-5f43-410c-8f82-d7961ffa3e7a" released by "delete_volume" :: held 0.977s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:25 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created reservations ['183c448c-f8d0-4051-a57f-4f1bf3251e3e', '60f6f5c2-b3a0-4e85-979e-d1373ebee5ef', '49dc27ac-d8aa-4448-9ccc-604ed2628947', '19dfd8f9-f66e-4b0d-a4aa-f52bb2935bf1'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:26 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:26 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:26 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:26 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:26 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.329s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:26 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Deleted volume successfully. Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8367d5da-cf57-4730-b651-13a1d55e55f1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-bbd55538-5f43-410c-8f82-d7961ffa3e7a-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:26 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.456s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:36:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-quobyte-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68" acquired by "delete_volume" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a498198-74f4-40b1-b32a-417139082e78]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:27 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68 Sep 07 02:36:27 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Flow 'volume_create_manager' (ba7b24d4-6ec7-4109-bf92-51f9dd120587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c52df34-a1e5-4cb3-a7ef-aab7c9ede2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c52df34-a1e5-4cb3-a7ef-aab7c9ede2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5226d4-d4f2-429b-ad5f-9ed76d4880a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd18f94ef9394995abb68df2c8d49bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:28Z,use_quota=True,user_id='4cea69914f36446288ec6fd941428567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54411d90-f084-49ed-b5bb-0614d0d9b10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54411d90-f084-49ed-b5bb-0614d0d9b10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:27 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cfc9be-612b-426d-87e1-d01564b2f513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG cinder.image.glance [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Creating Keystone auth plugin from conf {{(pid=87313) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68" returned: 0 in 0.463s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:27 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68 Sep 07 02:36:27 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1cfc9be-612b-426d-87e1-d01564b2f513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a5226d4-d4f2-429b-ad5f-9ed76d4880a5', 'volume_name': 'volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5', 'volume_size': 1, 'image_id': '83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6427f73df5adad76c01ea2446084cf9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd18f94ef9394995abb68df2c8d49bc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bc33ed698274ba551669595c816d2f6981c9927095a5ffa837d36c5d0983498eb82c94cf9f281034ba2f44f42dc194a2b323906d29f743e620518518b62e056', 'id': '83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'created_at': datetime.datetime(2026, 9, 7, 0, 36, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 36, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83a3ff71-fe0f-4e2d-a5da-7da10ab8128e/file', 'properties': {}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb08bdf-9c5e-4fd7-b635-03296fd984fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb08bdf-9c5e-4fd7-b635-03296fd984fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5dba20-47cd-4424-83fb-70e258dec225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:28 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Volume 1a5226d4-d4f2-429b-ad5f-9ed76d4880a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5', 'volume_size': 1, 'image_id': '83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6427f73df5adad76c01ea2446084cf9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd18f94ef9394995abb68df2c8d49bc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bc33ed698274ba551669595c816d2f6981c9927095a5ffa837d36c5d0983498eb82c94cf9f281034ba2f44f42dc194a2b323906d29f743e620518518b62e056', 'id': '83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'created_at': datetime.datetime(2026, 9, 7, 0, 36, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 36, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83a3ff71-fe0f-4e2d-a5da-7da10ab8128e/file', 'properties': {}}, 'image_service': } Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Trying to clone 1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 from image 83a3ff71-fe0f-4e2d-a5da-7da10ab8128e at location (None, [{'url': 'file:///opt/stack/data/glance/images/83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'metadata': {}}]). {{(pid=87313) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 02:36:28 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68" returned: 0 in 0.282s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68" released by "delete_volume" :: held 0.804s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created reservations ['2c8587f7-d320-4f16-836e-bcc272584f0e', 'b69161c5-0a40-4b04-bdbc-30a0661dd6ff', '4e106a9c-2031-4c8c-aebc-d31f992780ef', '699f56ea-ae2b-4e74-9d5c-3109a3320ef2'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 02:36:28 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Image download 0.00 MB at 0.00 MB/s Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7e3295-1a7a-46f8-a712-2768dda17717]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:28 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:28 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:28 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-a89d3106-7220-4614-b715-271dae0c0915-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:28 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-a89d3106-7220-4614-b715-271dae0c0915-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-quobyte-a89d3106-7220-4614-b715-271dae0c0915" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-a89d3106-7220-4614-b715-271dae0c0915" acquired by "delete_volume" :: waited 0.029s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[48718995-d09c-4efa-8074-7cf5a5b557c8]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:28 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.454s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:28 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Deleted volume successfully. Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ecd459aa-de36-4a5b-bf43-4f6a8cad7ef0 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-4b7390eb-06f0-4e2b-9f7d-ffe4cabd5d68-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:28 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:28 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915 Sep 07 02:36:28 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:29 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD Sep 07 02:36:29 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:29 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915" returned: 0 in 0.554s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:29 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD" returned: 1 in 0.481s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Temporary image 83a3ff71-fe0f-4e2d-a5da-7da10ab8128e is fetched for user 4cea69914f36446288ec6fd941428567. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 02:36:29 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915 Sep 07 02:36:29 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[9046b022-dbd3-4e79-8973-3156f89a9024]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:29 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD Sep 07 02:36:29 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:29 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a89d3106-7220-4614-b715-271dae0c0915" returned: 0 in 0.304s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-a89d3106-7220-4614-b715-271dae0c0915" released by "delete_volume" :: held 0.949s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created reservations ['b755638f-82b1-4aa6-95a5-6aeefb4e4d26', '27ea9c21-730a-43a8-acba-4e62e775c5ea', '87a9366b-9835-4ad5-a8a4-57bb03b1b832', '21399d8e-5d8a-41e6-a26a-474ae973f487'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:29 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:29 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:29 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:30 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD Sep 07 02:36:30 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:30 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.314s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:30 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Deleted volume successfully. Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f0487184-ae58-43de-9db8-dc66631cacb9 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-a89d3106-7220-4614-b715-271dae0c0915-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:30 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5226d4-d4f2-429b-ad5f-9ed76d4880a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd18f94ef9394995abb68df2c8d49bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:28Z,use_quota=True,user_id='4cea69914f36446288ec6fd941428567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Creating volume 1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:30 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:30 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 1073741824 Sep 07 02:36:30 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:30 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 1073741824" returned: 0 in 0.506s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:30 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 Sep 07 02:36:30 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "cinder-quobyte-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c836c8a-b6bf-4c4d-9433-caee052a7fdb]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:31 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5" returned: 0 in 0.337s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Attempting download of 83a3ff71-fe0f-4e2d-a5da-7da10ab8128e ((None, [{'url': 'file:///opt/stack/data/glance/images/83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'metadata': {}}])) to volume 1a5226d4-d4f2-429b-ad5f-9ed76d4880a5. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 02:36:31 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d Sep 07 02:36:31 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac01aac-1b85-43fe-add8-db39ea70b28b]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_w7xhim_q {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:31 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_w7xhim_q Sep 07 02:36:31 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:31 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d" returned: 0 in 0.481s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:31 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d Sep 07 02:36:31 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:31 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_w7xhim_q" returned: 0 in 0.424s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_w7xhim_q {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:31 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_w7xhim_q Sep 07 02:36:31 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:31 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d" returned: 0 in 0.300s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-quobyte-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d" released by "delete_volume" :: held 0.827s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Created reservations ['9ccdf49d-8614-4267-b50c-98111b7a0d91', 'de8c9755-76d8-43fe-b28b-963da35ae861', 'ae1b2a4c-ff76-49b2-8707-02a72cda775a', '4d9ef5b5-f038-4293-8e19-c0420b5ceb20'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:32 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_w7xhim_q" returned: 1 in 0.442s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_w7xhim_q' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:36:32 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:32 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c5855a-8499-411e-a8b0-830279990f4f]: (4, 'raw') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:32 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD Sep 07 02:36:32 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:32 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.395s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:32 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Deleted volume successfully. Sep 07 02:36:32 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:32 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-285d27fb-cf3d-46c1-9f47-f8ab77d78cf1 tempest-CreateVolumesFromSourceVolumeTest-1928847312 None] Lock "cinder-03b8fbff-6fd9-4c26-82c7-fa3f5deaf56d-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:32 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD Sep 07 02:36:32 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:33 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 02:36:33 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] 83a3ff71-fe0f-4e2d-a5da-7da10ab8128e was raw, converting to qcow2 {{(pid=87313) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 02:36:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:33 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 Sep 07 02:36:33 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:33 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5" returned: 0 in 0.786s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:33 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83a3ff71-fe0f-4e2d-a5da-7da10ab8128e_pxxn8iicdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:36:33 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 02:36:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:33 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 1G Sep 07 02:36:33 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:34 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 1G" returned: 0 in 0.520s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:34 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Downloaded image 83a3ff71-fe0f-4e2d-a5da-7da10ab8128e ((None, [{'url': 'file:///opt/stack/data/glance/images/83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'metadata': {}}])) to volume 1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 successfully. {{(pid=87313) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 02:36:34 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Temporary image 83a3ff71-fe0f-4e2d-a5da-7da10ab8128e for user 4cea69914f36446288ec6fd941428567 is deleted. {{(pid=87313) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 02:36:34 devstack cinder-volume[87313]: DEBUG cinder.volume.volume_utils [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Marking volume 1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 as bootable. {{(pid=87313) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 02:36:34 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Copying metadata from image 83a3ff71-fe0f-4e2d-a5da-7da10ab8128e to 1a5226d4-d4f2-429b-ad5f-9ed76d4880a5. {{(pid=87313) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 02:36:34 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Creating volume glance metadata for volume 1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 backed by image 83a3ff71-fe0f-4e2d-a5da-7da10ab8128e with: {'image_id': '83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6427f73df5adad76c01ea2446084cf9f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87313) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 02:36:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5dba20-47cd-4424-83fb-70e258dec225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5', 'volume_size': 1, 'image_id': '83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6427f73df5adad76c01ea2446084cf9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd18f94ef9394995abb68df2c8d49bc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bc33ed698274ba551669595c816d2f6981c9927095a5ffa837d36c5d0983498eb82c94cf9f281034ba2f44f42dc194a2b323906d29f743e620518518b62e056', 'id': '83a3ff71-fe0f-4e2d-a5da-7da10ab8128e', 'created_at': datetime.datetime(2026, 9, 7, 0, 36, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 0, 36, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83a3ff71-fe0f-4e2d-a5da-7da10ab8128e/file', 'properties': {}}, 'image_service': }' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb8d951-02a8-4eec-b78e-a0196d512051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:34 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Volume volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 (1a5226d4-d4f2-429b-ad5f-9ed76d4880a5): created successfully Sep 07 02:36:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb8d951-02a8-4eec-b78e-a0196d512051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:34 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Flow 'volume_create_manager' (ba7b24d4-6ec7-4109-bf92-51f9dd120587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1ca4cb11-ad1d-42fa-9f72-070d50c49fd4 tempest-VolumeImageDependencyTests-1055155434 None] Created volume successfully. Sep 07 02:36:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Acquiring lock "cinder-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Lock "cinder-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Acquiring lock "cinder-quobyte-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Lock "cinder-quobyte-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5" acquired by "delete_volume" :: waited 0.039s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf84f61-044d-4687-b763-335227e9bf08]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:36 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 Sep 07 02:36:36 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Flow 'volume_create_manager' (feb88dcf-23d1-49a5-aa85-b8f6a2e14b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028d927b-3d36-4ba2-8a9a-6c85f40eb2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028d927b-3d36-4ba2-8a9a-6c85f40eb2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69307bd2-186d-45db-9390-e08370ba71e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a19b1195954e17b034f14b6ae0884d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:36Z,use_quota=True,user_id='2bf29c5be6234f2b8b909c3ef81c138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050cdba3-80df-4ac1-87e2-a1997c5da9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050cdba3-80df-4ac1-87e2-a1997c5da9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38a38c1-bd76-43bd-ac50-e117ae9dcd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38a38c1-bd76-43bd-ac50-e117ae9dcd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69307bd2-186d-45db-9390-e08370ba71e7', 'volume_name': 'volume-69307bd2-186d-45db-9390-e08370ba71e7', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8643b9e4-ba95-4921-b5eb-8c08f5a9994c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8643b9e4-ba95-4921-b5eb-8c08f5a9994c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d0099a-8ab9-4998-a296-fa9c6142d183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:36 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Volume 69307bd2-186d-45db-9390-e08370ba71e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69307bd2-186d-45db-9390-e08370ba71e7', 'volume_size': 1} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69307bd2-186d-45db-9390-e08370ba71e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a19b1195954e17b034f14b6ae0884d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:36Z,use_quota=True,user_id='2bf29c5be6234f2b8b909c3ef81c138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Creating volume 69307bd2-186d-45db-9390-e08370ba71e7 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:36 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:36 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7 1073741824 Sep 07 02:36:36 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:36 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5" returned: 0 in 0.525s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:36 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5 Sep 07 02:36:36 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:37 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5" returned: 0 in 0.432s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Lock "cinder-quobyte-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5" released by "delete_volume" :: held 1.047s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Created reservations ['2405eb97-67cb-4545-bd2d-027bd2a2cca0', '5919a87b-a4a4-48ad-8000-94ee650b396e', '61c08b04-0e89-4e9b-a39b-edbdaf8c4a9c', 'ae2309d4-c3b8-4b62-a464-981ded23e710'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:37 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7 1073741824" returned: 0 in 0.667s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:37 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7 Sep 07 02:36:37 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:37 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:37 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:37 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:37 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.360s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7" returned: 0 in 0.353s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:37 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Deleted volume successfully. Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d0099a-8ab9-4998-a296-fa9c6142d183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69307bd2-186d-45db-9390-e08370ba71e7', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01d86cf-3fb9-4c17-af5b-d613d320c241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:37 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Volume volume-69307bd2-186d-45db-9390-e08370ba71e7 (69307bd2-186d-45db-9390-e08370ba71e7): created successfully Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01d86cf-3fb9-4c17-af5b-d613d320c241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Flow 'volume_create_manager' (feb88dcf-23d1-49a5-aa85-b8f6a2e14b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-20b9b074-a1c6-4212-a8a9-1ba92bf28187 tempest-VolumeImageDependencyTests-1055155434 None] Lock "cinder-1a5226d4-d4f2-429b-ad5f-9ed76d4880a5-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:37 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c180b038-121d-4989-908b-9a9f7aab9ffa tempest-CinderUnicodeTest-322723606 None] Created volume successfully. Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Flow 'volume_create_manager' (968aac65-3a9a-4680-9a7e-6b1029ee9258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e77a03-1693-480d-a3f3-1aee96e18270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e77a03-1693-480d-a3f3-1aee96e18270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-119958183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6810567e-1de7-4a29-9923-7b8f0e33625c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a19b1195954e17b034f14b6ae0884d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:39Z,use_quota=True,user_id='2bf29c5be6234f2b8b909c3ef81c138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad5b355-96cd-416c-a638-6ccc52f21068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad5b355-96cd-416c-a638-6ccc52f21068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115822c1-138b-4b4e-a17d-31ac56d8db1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115822c1-138b-4b4e-a17d-31ac56d8db1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6810567e-1de7-4a29-9923-7b8f0e33625c', 'volume_name': 'volume-6810567e-1de7-4a29-9923-7b8f0e33625c', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f49d55-238c-486d-a861-5fac576499eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f49d55-238c-486d-a861-5fac576499eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed56ea47-bb5d-4789-bf54-38c909c324ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:39 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Volume 6810567e-1de7-4a29-9923-7b8f0e33625c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6810567e-1de7-4a29-9923-7b8f0e33625c', 'volume_size': 1} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-119958183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6810567e-1de7-4a29-9923-7b8f0e33625c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a19b1195954e17b034f14b6ae0884d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:39Z,use_quota=True,user_id='2bf29c5be6234f2b8b909c3ef81c138b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Creating volume 6810567e-1de7-4a29-9923-7b8f0e33625c {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:39 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:39 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c 1073741824 Sep 07 02:36:39 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:40 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c 1073741824" returned: 0 in 0.647s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:40 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c Sep 07 02:36:40 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:40 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c" returned: 0 in 0.327s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed56ea47-bb5d-4789-bf54-38c909c324ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6810567e-1de7-4a29-9923-7b8f0e33625c', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83dc61d-74e1-41b8-8dc4-e98434650001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:40 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Volume volume-6810567e-1de7-4a29-9923-7b8f0e33625c (6810567e-1de7-4a29-9923-7b8f0e33625c): created successfully Sep 07 02:36:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83dc61d-74e1-41b8-8dc4-e98434650001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Flow 'volume_create_manager' (968aac65-3a9a-4680-9a7e-6b1029ee9258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-87c21ab0-ea88-406a-a00e-a493816477a3 tempest-CinderUnicodeTest-322723606 None] Created volume successfully. Sep 07 02:36:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:41 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] Creating offline snapshot 5531226e-da32-4b42-a4cc-d6b118effb9e of volume 6810567e-1de7-4a29-9923-7b8f0e33625c {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:36:41 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f90d66-7880-4829-87e4-f415f500d2aa]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:42 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c Sep 07 02:36:42 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:42 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c" returned: 0 in 0.488s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:42 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e 1G Sep 07 02:36:42 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:43 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e 1G" returned: 0 in 0.563s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6810567e-1de7-4a29-9923-7b8f0e33625c -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:43 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6810567e-1de7-4a29-9923-7b8f0e33625c -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e Sep 07 02:36:43 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Flow 'volume_create_manager' (690df149-5c66-40c1-b4bf-a33ceb62134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bea5e8-c6b3-4ca4-897f-c244d2fec2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bea5e8-c6b3-4ca4-897f-c244d2fec2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-271548364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9915906b-50bb-41be-801d-5a8da3694ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05cf558044f34498ae0744dfdad38814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:43Z,use_quota=True,user_id='e20b0cdc2cbf44aaa8911468e1444326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3233b7-b638-41e9-b241-87582f0d6ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3233b7-b638-41e9-b241-87582f0d6ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a952f875-d8a9-46a4-a103-622d4eacd485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a952f875-d8a9-46a4-a103-622d4eacd485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9915906b-50bb-41be-801d-5a8da3694ba3', 'volume_name': 'volume-9915906b-50bb-41be-801d-5a8da3694ba3', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae69ce7-5537-4f5d-a29b-27529592ffde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae69ce7-5537-4f5d-a29b-27529592ffde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ecaff2-65c4-4577-924b-6d8bc21c61ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:43 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Volume 9915906b-50bb-41be-801d-5a8da3694ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9915906b-50bb-41be-801d-5a8da3694ba3', 'volume_size': 1} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:43 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6810567e-1de7-4a29-9923-7b8f0e33625c -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e" returned: 0 in 0.399s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:43 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e is being set with open permissions: ugo+rw Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:43 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e Sep 07 02:36:43 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:43 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e" returned: 0 in 0.265s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:43 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.info Sep 07 02:36:43 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:43 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-d826d954-90eb-438b-b0e1-a8ea2b8d240c tempest-ProjectAdminTests-267568945 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6277351379395, 'free_capacity_gb': 1773.6277351379395, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87313) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 02:36:44 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.info" returned: 0 in 0.295s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:44 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.info is being set with open permissions: ugo+rw Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:44 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.info Sep 07 02:36:44 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:44 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.info" returned: 0 in 0.286s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.434s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.100s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-271548364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9915906b-50bb-41be-801d-5a8da3694ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05cf558044f34498ae0744dfdad38814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:43Z,use_quota=True,user_id='e20b0cdc2cbf44aaa8911468e1444326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Creating volume 9915906b-50bb-41be-801d-5a8da3694ba3 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:44 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:44 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 1073741824 Sep 07 02:36:44 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:44 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-12258e8d-f580-4429-84db-ed62d293d9d6 tempest-CinderUnicodeTest-322723606 None] Create snapshot completed successfully Sep 07 02:36:44 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 1073741824" returned: 0 in 0.538s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=180,cinder:UPDATE=257,cinder:INSERT=72,cinder:DELETE=17 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:36:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:45 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 Sep 07 02:36:45 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Acquiring lock "cinder-5531226e-da32-4b42-a4cc-d6b118effb9e-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Lock "cinder-5531226e-da32-4b42-a4cc-d6b118effb9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Acquiring lock "cinder-quobyte-6810567e-1de7-4a29-9923-7b8f0e33625c" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Lock "cinder-quobyte-6810567e-1de7-4a29-9923-7b8f0e33625c" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Acquiring lock "cinder-quobyte-5531226e-da32-4b42-a4cc-d6b118effb9e" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Lock "cinder-quobyte-5531226e-da32-4b42-a4cc-d6b118effb9e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:45 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Deleting offline snapshot 5531226e-da32-4b42-a4cc-d6b118effb9e of volume 6810567e-1de7-4a29-9923-7b8f0e33625c {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] snapshot_file for this snap is: volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3" returned: 0 in 0.376s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[abffd32e-9ed0-458f-b4f6-45201917878f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ecaff2-65c4-4577-924b-6d8bc21c61ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9915906b-50bb-41be-801d-5a8da3694ba3', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bfea2a-58c9-448c-a9fb-43e23f12fb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:45 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Volume volume-9915906b-50bb-41be-801d-5a8da3694ba3 (9915906b-50bb-41be-801d-5a8da3694ba3): created successfully Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bfea2a-58c9-448c-a9fb-43e23f12fb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Flow 'volume_create_manager' (690df149-5c66-40c1-b4bf-a33ceb62134a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:45 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8776650d-32b8-46d8-9141-57f2dc4740be tempest-SnapshotDependencyTests-955237384 None] Created volume successfully. Sep 07 02:36:45 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e Sep 07 02:36:45 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:45 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e" returned: 0 in 0.471s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6810567e-1de7-4a29-9923-7b8f0e33625c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a96bec-f632-461c-82cb-616423332aea]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:45 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c Sep 07 02:36:45 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:46 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c" returned: 0 in 0.434s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:46 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e Sep 07 02:36:46 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] Creating offline snapshot 1860f206-eb07-43ac-8d3a-094fcd4ddac8 of volume 9915906b-50bb-41be-801d-5a8da3694ba3 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:36:46 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[69892ce7-1733-413d-8cc6-05a972399e44]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:46 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e" returned: 0 in 0.446s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:46 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e Sep 07 02:36:46 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:46 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 Sep 07 02:36:46 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:47 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c.5531226e-da32-4b42-a4cc-d6b118effb9e" returned: 0 in 0.311s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:47 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Lock "cinder-quobyte-5531226e-da32-4b42-a4cc-d6b118effb9e" released by "_delete_snapshot" :: held 1.824s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3" returned: 0 in 0.480s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Lock "cinder-quobyte-6810567e-1de7-4a29-9923-7b8f0e33625c" released by "delete_snapshot" :: held 1.864s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:47 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 1G Sep 07 02:36:47 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Created reservations ['03f42d69-ab3b-4266-bdb5-4064d3735ec3', '4f3ffaac-57cc-4acc-a1b2-c648e85b4e28', '26f49540-b17f-47e9-8a9e-6d525f517af4', 'af39a310-cc47-4147-8723-42cc1c674a16'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:47 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Delete snapshot completed successfully. Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-f32ff842-c731-4964-9a91-b9aa0ce8d9c7 tempest-CinderUnicodeTest-322723606 None] Lock "cinder-5531226e-da32-4b42-a4cc-d6b118effb9e-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Acquiring lock "cinder-6810567e-1de7-4a29-9923-7b8f0e33625c-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Lock "cinder-6810567e-1de7-4a29-9923-7b8f0e33625c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Acquiring lock "cinder-quobyte-6810567e-1de7-4a29-9923-7b8f0e33625c" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Lock "cinder-quobyte-6810567e-1de7-4a29-9923-7b8f0e33625c" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a40ea0e-b573-425e-ab2b-78d95775cce6]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:47 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 1G" returned: 0 in 0.589s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9915906b-50bb-41be-801d-5a8da3694ba3 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:47 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c Sep 07 02:36:47 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:47 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9915906b-50bb-41be-801d-5a8da3694ba3 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 Sep 07 02:36:47 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Flow 'volume_create_manager' (e230f6b3-e3ce-4930-a4d5-7a33349522ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508565bd-fd05-41f4-8673-75b1e693a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508565bd-fd05-41f4-8673-75b1e693a86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30071902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6e6f3e-2a11-4689-8650-4cb269f9f12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd70b9eb3fe94530b82ac90118cc6d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:48Z,use_quota=True,user_id='4086e873c720489abb57f4c3a6516efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fd9821-3195-4bf3-bdf0-be3149e5788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:48 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fd9821-3195-4bf3-bdf0-be3149e5788b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ee28aa-93dd-4fc9-a5ee-3cb5842f98db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ee28aa-93dd-4fc9-a5ee-3cb5842f98db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6e6f3e-2a11-4689-8650-4cb269f9f12a', 'volume_name': 'volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a78aa3-ff9c-4ba0-ac6e-0c537551a940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a78aa3-ff9c-4ba0-ac6e-0c537551a940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950674e6-a433-4226-adbd-2200c900a65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:48 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Volume bb6e6f3e-2a11-4689-8650-4cb269f9f12a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a', 'volume_size': 1} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c" returned: 0 in 0.515s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:48 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9915906b-50bb-41be-801d-5a8da3694ba3 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8" returned: 0 in 0.409s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:48 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 is being set with open permissions: ugo+rw Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:48 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c Sep 07 02:36:48 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:48 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 Sep 07 02:36:48 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:48 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-6810567e-1de7-4a29-9923-7b8f0e33625c" returned: 0 in 0.284s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:48 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8" returned: 0 in 0.277s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Lock "cinder-quobyte-6810567e-1de7-4a29-9923-7b8f0e33625c" released by "delete_volume" :: held 0.882s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:48 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.info Sep 07 02:36:48 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Created reservations ['c63ca8f6-b4b1-4e0c-9592-bc7716153ebe', 'aa65f5b3-bfc6-49a6-8396-610b07341b76', 'cbb5f6d3-02fa-491e-a46a-0d2cafcb77e9', 'd2db3fae-0828-4cab-b201-7a612bce2889'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:48 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:48 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Acquiring lock "cinder-69307bd2-186d-45db-9390-e08370ba71e7-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Lock "cinder-69307bd2-186d-45db-9390-e08370ba71e7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Acquiring lock "cinder-quobyte-69307bd2-186d-45db-9390-e08370ba71e7" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Lock "cinder-quobyte-69307bd2-186d-45db-9390-e08370ba71e7" acquired by "delete_volume" :: waited 0.038s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf3fa14-526d-4375-a93f-bbf46716d7da]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:48 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.info" returned: 0 in 0.412s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:48 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.info is being set with open permissions: ugo+rw Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:48 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.335s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:48 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.info Sep 07 02:36:48 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:48 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Deleted volume successfully. Sep 07 02:36:48 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b84a2891-438c-43ab-b1f5-9d3c381c54de tempest-CinderUnicodeTest-322723606 None] Lock "cinder-6810567e-1de7-4a29-9923-7b8f0e33625c-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:49 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7 Sep 07 02:36:49 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:49 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.info" returned: 0 in 0.358s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.635s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30071902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6e6f3e-2a11-4689-8650-4cb269f9f12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd70b9eb3fe94530b82ac90118cc6d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:48Z,use_quota=True,user_id='4086e873c720489abb57f4c3a6516efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Creating volume bb6e6f3e-2a11-4689-8650-4cb269f9f12a {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:49 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:49 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a 1073741824 Sep 07 02:36:49 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:49 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1a0b4a83-cc2d-40cc-b459-29bbc6a8b9ca tempest-SnapshotDependencyTests-955237384 None] Create snapshot completed successfully Sep 07 02:36:49 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7" returned: 0 in 0.466s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:49 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7 Sep 07 02:36:49 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:49 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-69307bd2-186d-45db-9390-e08370ba71e7" returned: 0 in 0.244s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Lock "cinder-quobyte-69307bd2-186d-45db-9390-e08370ba71e7" released by "delete_volume" :: held 0.774s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Created reservations ['711c19c5-68ff-49b3-817c-9c0b3693318c', 'f285f789-23ed-48d7-9fc3-185857a2c1af', '030b2621-ccba-4f66-8a1b-169ed470747c', '849bc3c7-2ad7-4c9d-9e16-f1adda73393c'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:49 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a 1073741824" returned: 0 in 0.445s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:49 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:49 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:49 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a Sep 07 02:36:49 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:49 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.281s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:49 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:49 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Deleted volume successfully. Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-4ede717c-d015-4e71-9705-6fa03caa4237 tempest-CinderUnicodeTest-322723606 None] Lock "cinder-69307bd2-186d-45db-9390-e08370ba71e7-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:50 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a" returned: 0 in 0.330s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950674e6-a433-4226-adbd-2200c900a65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f937102-aad4-4120-83ed-5add6fcfdaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:50 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Volume volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a (bb6e6f3e-2a11-4689-8650-4cb269f9f12a): created successfully Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f937102-aad4-4120-83ed-5add6fcfdaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Flow 'volume_create_manager' (e230f6b3-e3ce-4930-a4d5-7a33349522ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-64116321-ef8e-49ee-a278-65d3dd1f7830 tempest-ProjectReaderTests-2056874709 None] Created volume successfully. Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Flow 'volume_create_manager' (ca3c11ad-a75f-4559-b7b4-b567bec0223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f986521-bed6-4d4e-8e03-0caeaf1f1449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f986521-bed6-4d4e-8e03-0caeaf1f1449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6d924e-4d5d-4c9c-b32d-5a4673900466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05cf558044f34498ae0744dfdad38814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1860f206-eb07-43ac-8d3a-094fcd4ddac8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:50Z,use_quota=True,user_id='e20b0cdc2cbf44aaa8911468e1444326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219cdc84-a0ab-43d0-883a-a9fbf5de767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219cdc84-a0ab-43d0-883a-a9fbf5de767c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dff2c4-4081-4669-85f5-9b92e6bbee94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dff2c4-4081-4669-85f5-9b92e6bbee94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ef6d924e-4d5d-4c9c-b32d-5a4673900466', 'volume_name': 'volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466', 'volume_size': 1, 'snapshot_id': '1860f206-eb07-43ac-8d3a-094fcd4ddac8'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e611b01b-41ff-4a20-ae68-d5fef8b52c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e611b01b-41ff-4a20-ae68-d5fef8b52c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c321f9-0ee0-4713-b946-3ff012b42cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:50 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Volume ef6d924e-4d5d-4c9c-b32d-5a4673900466: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466', 'volume_size': 1, 'snapshot_id': '1860f206-eb07-43ac-8d3a-094fcd4ddac8'} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "cinder-quobyte-1860f206-eb07-43ac-8d3a-094fcd4ddac8-ef6d924e-4d5d-4c9c-b32d-5a4673900466" by "_create_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-1860f206-eb07-43ac-8d3a-094fcd4ddac8-ef6d924e-4d5d-4c9c-b32d-5a4673900466" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Creating volume ef6d924e-4d5d-4c9c-b32d-5a4673900466 from snapshot 1860f206-eb07-43ac-8d3a-094fcd4ddac8 {{(pid=87313) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "cinder-quobyte-ef6d924e-4d5d-4c9c-b32d-5a4673900466" by "_copy_volume_from_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-ef6d924e-4d5d-4c9c-b32d-5a4673900466" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] snapshot: 1860f206-eb07-43ac-8d3a-094fcd4ddac8, volume: ef6d924e-4d5d-4c9c-b32d-5a4673900466, {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b3e89c-5003-4a5e-b2f2-355dd044d406]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:50 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 Sep 07 02:36:50 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:51 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8" returned: 0 in 0.464s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9915906b-50bb-41be-801d-5a8da3694ba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb92c02-48c3-4c6c-8e3d-a1c561ee2491]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:51 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 Sep 07 02:36:51 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "cinder-bb6e6f3e-2a11-4689-8650-4cb269f9f12a-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-bb6e6f3e-2a11-4689-8650-4cb269f9f12a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "cinder-quobyte-bb6e6f3e-2a11-4689-8650-4cb269f9f12a" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-quobyte-bb6e6f3e-2a11-4689-8650-4cb269f9f12a" acquired by "delete_volume" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:51 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[840b5faa-1001-4618-a18b-eeb3ff9c4b4e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3" returned: 0 in 0.531s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Creating direct copy from snapshot {{(pid=87313) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG cinder.utils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Path /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 not found in is_blk_device check {{(pid=87313) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 02:36:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:51 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 Sep 07 02:36:51 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:51 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a Sep 07 02:36:51 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:52 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a" returned: 0 in 0.404s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:52 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a Sep 07 02:36:52 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:52 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bb6e6f3e-2a11-4689-8650-4cb269f9f12a" returned: 0 in 0.395s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-quobyte-bb6e6f3e-2a11-4689-8650-4cb269f9f12a" released by "delete_volume" :: held 0.868s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:52 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Created reservations ['cee22ff2-d1b0-4ba8-b9c2-c83ee4b00636', '43d5271a-bd49-4cb8-b331-0be580d8b4cd', 'e89c826d-303c-4aee-8517-a1196e5e1782', 'a714800a-6476-4091-8b02-f9eaeb9b4c31'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:36:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:53 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:36:53 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:53 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.753s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:53 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:36:53 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Deleted volume successfully. Sep 07 02:36:53 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03d1c330-02c6-4a88-ab47-8214429859f9 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-bb6e6f3e-2a11-4689-8650-4cb269f9f12a-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Flow 'volume_create_manager' (7f3f621c-e4fe-4ba3-8636-d3c622f72fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e9cd3f-7499-4703-8b53-f8febe9ae58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e9cd3f-7499-4703-8b53-f8febe9ae58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584317252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8fb326a-7fe9-49e2-84c8-496f448a559e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd70b9eb3fe94530b82ac90118cc6d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:55Z,use_quota=True,user_id='4086e873c720489abb57f4c3a6516efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437d8456-6e2e-4076-a368-42408c8fc63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437d8456-6e2e-4076-a368-42408c8fc63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa583c5-fb74-45a2-ba94-93f77f863d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa583c5-fb74-45a2-ba94-93f77f863d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8fb326a-7fe9-49e2-84c8-496f448a559e', 'volume_name': 'volume-b8fb326a-7fe9-49e2-84c8-496f448a559e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722aadc7-522b-4bb2-851e-92ab3a0d1b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722aadc7-522b-4bb2-851e-92ab3a0d1b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42600143-dfbb-4f99-9dff-83e8f0737954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:55 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Volume b8fb326a-7fe9-49e2-84c8-496f448a559e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8fb326a-7fe9-49e2-84c8-496f448a559e', 'volume_size': 1} Sep 07 02:36:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:58 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466" returned: 0 in 6.396s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.image.image_utils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Image conversion details: src /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 {{(pid=87313) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 02:36:58 devstack cinder-volume[87313]: INFO cinder.image.image_utils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Converted 1024.00 MB image at 160.01 MB/s Sep 07 02:36:58 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 is being set with open permissions: ugo+rw Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:58 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 Sep 07 02:36:58 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:58 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466" returned: 0 in 0.293s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-ef6d924e-4d5d-4c9c-b32d-5a4673900466" released by "_copy_volume_from_snapshot" :: held 7.787s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-1860f206-eb07-43ac-8d3a-094fcd4ddac8-ef6d924e-4d5d-4c9c-b32d-5a4673900466" released by "_create_volume_from_snapshot" :: held 7.864s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.887s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.036s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584317252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8fb326a-7fe9-49e2-84c8-496f448a559e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd70b9eb3fe94530b82ac90118cc6d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:36:55Z,use_quota=True,user_id='4086e873c720489abb57f4c3a6516efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Creating volume b8fb326a-7fe9-49e2-84c8-496f448a559e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:36:58 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:58 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e 1073741824 Sep 07 02:36:58 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c321f9-0ee0-4713-b946-3ff012b42cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466', 'volume_size': 1, 'snapshot_id': '1860f206-eb07-43ac-8d3a-094fcd4ddac8'}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accd0482-e5db-4d35-a399-071399100885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:58 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Volume volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 (ef6d924e-4d5d-4c9c-b32d-5a4673900466): created successfully Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accd0482-e5db-4d35-a399-071399100885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:58 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Flow 'volume_create_manager' (ca3c11ad-a75f-4559-b7b4-b567bec0223a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:58 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-17b00dca-faa7-4a0e-bbed-7ecf73826177 tempest-SnapshotDependencyTests-955237384 None] Created volume successfully. Sep 07 02:36:59 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e 1073741824" returned: 0 in 0.549s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:59 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e Sep 07 02:36:59 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:59 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e" returned: 0 in 0.271s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42600143-dfbb-4f99-9dff-83e8f0737954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8fb326a-7fe9-49e2-84c8-496f448a559e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89c6eb8-afb5-447c-bed2-f94188ffa553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:36:59 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Volume volume-b8fb326a-7fe9-49e2-84c8-496f448a559e (b8fb326a-7fe9-49e2-84c8-496f448a559e): created successfully Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89c6eb8-afb5-447c-bed2-f94188ffa553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Flow 'volume_create_manager' (7f3f621c-e4fe-4ba3-8636-d3c622f72fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:36:59 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-00bdf952-f813-4fae-a801-ebabf52a9742 tempest-ProjectReaderTests-2056874709 None] Created volume successfully. Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "cinder-1860f206-eb07-43ac-8d3a-094fcd4ddac8-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-1860f206-eb07-43ac-8d3a-094fcd4ddac8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "cinder-quobyte-9915906b-50bb-41be-801d-5a8da3694ba3" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-9915906b-50bb-41be-801d-5a8da3694ba3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "cinder-quobyte-1860f206-eb07-43ac-8d3a-094fcd4ddac8" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-1860f206-eb07-43ac-8d3a-094fcd4ddac8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Deleting offline snapshot 1860f206-eb07-43ac-8d3a-094fcd4ddac8 of volume 9915906b-50bb-41be-801d-5a8da3694ba3 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] snapshot_file for this snap is: volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca3f838-bdbb-4644-ba68-46e3368aab79]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "cinder-b8fb326a-7fe9-49e2-84c8-496f448a559e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-b8fb326a-7fe9-49e2-84c8-496f448a559e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:36:59 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 Sep 07 02:36:59 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "cinder-quobyte-b8fb326a-7fe9-49e2-84c8-496f448a559e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:36:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-quobyte-b8fb326a-7fe9-49e2-84c8-496f448a559e" acquired by "delete_volume" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67a0f9e-30aa-4c45-a3d1-b5a45db8b994]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:00 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e Sep 07 02:37:00 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:00 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8" returned: 0 in 0.536s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9915906b-50bb-41be-801d-5a8da3694ba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[17685fc9-095c-4467-9bfd-e73a176751f5]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:00 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 Sep 07 02:37:00 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:00 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e" returned: 0 in 0.460s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:00 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e Sep 07 02:37:00 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:00 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-b8fb326a-7fe9-49e2-84c8-496f448a559e" returned: 0 in 0.320s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-quobyte-b8fb326a-7fe9-49e2-84c8-496f448a559e" released by "delete_volume" :: held 0.847s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=169,cinder:INSERT=61,cinder:UPDATE=232,cinder:DELETE=27 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Created reservations ['a9e24461-9e0e-4d0d-8c8f-5668f37e7d6d', 'ff0ff5e2-7219-42f2-a59e-4275027a9bf7', '2a83d83c-0728-48b1-adc9-bf5fab9838f0', '1b977f25-a148-4913-8859-9dd94fc6554b'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:00 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3" returned: 0 in 0.645s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:01 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 Sep 07 02:37:01 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:01 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:01 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Flow 'volume_create_manager' (964a8fb0-9023-4d90-bc45-dbc24a828990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e21af9c-eef0-4c0e-b5e7-c0c78a50ebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e21af9c-eef0-4c0e-b5e7-c0c78a50ebd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914441993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fcb1db-0668-4ce3-82f4-8f6edea4d943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631bc1801c7a4871b6f3a9849d1d6697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:01Z,use_quota=True,user_id='07e30d74f6a2421b9c3a760f5cd7da60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261dc53b-7157-444b-9a77-f935deaa1355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261dc53b-7157-444b-9a77-f935deaa1355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a48caa3-14c9-4a70-913f-e56d0294f66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a48caa3-14c9-4a70-913f-e56d0294f66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07fcb1db-0668-4ce3-82f4-8f6edea4d943', 'volume_name': 'volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8b2d9d-ab90-4261-a2eb-0324bf4c7558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8b2d9d-ab90-4261-a2eb-0324bf4c7558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fffb12-0583-4040-a304-df4831179c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:01 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Volume 07fcb1db-0668-4ce3-82f4-8f6edea4d943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943', 'volume_size': 1} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914441993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fcb1db-0668-4ce3-82f4-8f6edea4d943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631bc1801c7a4871b6f3a9849d1d6697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:01Z,use_quota=True,user_id='07e30d74f6a2421b9c3a760f5cd7da60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Creating volume 07fcb1db-0668-4ce3-82f4-8f6edea4d943 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:37:01 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:01 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.404s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Deleted volume successfully. Sep 07 02:37:01 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8" returned: 0 in 0.480s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:01 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943 1073741824 Sep 07 02:37:01 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-bc8c8105-ac90-4f0c-9133-58854b3310c7 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-b8fb326a-7fe9-49e2-84c8-496f448a559e-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:01 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8 Sep 07 02:37:01 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:01 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3.1860f206-eb07-43ac-8d3a-094fcd4ddac8" returned: 0 in 0.357s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Flow 'volume_create_manager' (518ebf02-9053-470a-9f9d-4a3eb401dcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632a8349-83cc-4ea7-8a24-3e249377f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632a8349-83cc-4ea7-8a24-3e249377f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2041966243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94abe07-711f-4fde-bc2f-ea14fe1e1e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd70b9eb3fe94530b82ac90118cc6d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:02Z,use_quota=True,user_id='4086e873c720489abb57f4c3a6516efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5411f5b8-81b7-44c9-9b65-8231c3c5c78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5411f5b8-81b7-44c9-9b65-8231c3c5c78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eafcf5d-c2f3-4249-80c9-eaab2d9bb7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eafcf5d-c2f3-4249-80c9-eaab2d9bb7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94abe07-711f-4fde-bc2f-ea14fe1e1e70', 'volume_name': 'volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159416dd-da92-4abf-bcd5-aa98a40c9c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159416dd-da92-4abf-bcd5-aa98a40c9c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474bd227-62fb-4125-b735-f3e2ad1774e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:01 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Volume a94abe07-711f-4fde-bc2f-ea14fe1e1e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70', 'volume_size': 1} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-1860f206-eb07-43ac-8d3a-094fcd4ddac8" released by "_delete_snapshot" :: held 2.241s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-9915906b-50bb-41be-801d-5a8da3694ba3" released by "delete_snapshot" :: held 2.273s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:01 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943 1073741824" returned: 0 in 0.564s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Created reservations ['82b8f5a9-d3ee-4267-9211-f13c6ea1b847', '8a8f5841-3e4f-4c68-88ca-d5239305c3fc', '1ee3be3e-e39b-4459-8e2f-09bf972fade8', '5cbd37d7-04eb-44b8-a5b1-fe67fa236238'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:02 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943 Sep 07 02:37:02 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Delete snapshot completed successfully. Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ffcdcb6f-ab90-4c50-945c-19b0ae9ddb4d tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-1860f206-eb07-43ac-8d3a-094fcd4ddac8-delete_snapshot" released by "delete_snapshot" :: held 2.459s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:02 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943" returned: 0 in 0.260s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.375s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2041966243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94abe07-711f-4fde-bc2f-ea14fe1e1e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd70b9eb3fe94530b82ac90118cc6d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:02Z,use_quota=True,user_id='4086e873c720489abb57f4c3a6516efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Creating volume a94abe07-711f-4fde-bc2f-ea14fe1e1e70 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:37:02 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fffb12-0583-4040-a304-df4831179c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:02 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70 1073741824 Sep 07 02:37:02 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eea67d0-dc05-4059-9125-7b7c37e01870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:02 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Volume volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943 (07fcb1db-0668-4ce3-82f4-8f6edea4d943): created successfully Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eea67d0-dc05-4059-9125-7b7c37e01870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Flow 'volume_create_manager' (964a8fb0-9023-4d90-bc45-dbc24a828990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:02 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-32a72837-1f30-412c-a38f-149bc767d267 tempest-ProjectReaderTests-2040663305 None] Created volume successfully. Sep 07 02:37:02 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70 1073741824" returned: 0 in 0.451s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:02 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70 Sep 07 02:37:02 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "cinder-9915906b-50bb-41be-801d-5a8da3694ba3-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-9915906b-50bb-41be-801d-5a8da3694ba3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "cinder-quobyte-9915906b-50bb-41be-801d-5a8da3694ba3" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:02 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-9915906b-50bb-41be-801d-5a8da3694ba3" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce5864-40fd-4096-865f-b13d307eed32]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:03 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70" returned: 0 in 0.286s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474bd227-62fb-4125-b735-f3e2ad1774e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e7b7b6-bfa6-4d53-8fcd-790c30c88365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:03 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Volume volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70 (a94abe07-711f-4fde-bc2f-ea14fe1e1e70): created successfully Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e7b7b6-bfa6-4d53-8fcd-790c30c88365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Flow 'volume_create_manager' (518ebf02-9053-470a-9f9d-4a3eb401dcc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:03 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e4e72baf-3b63-4793-9375-11abd705229d tempest-ProjectReaderTests-2056874709 None] Created volume successfully. Sep 07 02:37:03 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 Sep 07 02:37:03 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:03 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3" returned: 0 in 0.392s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:03 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3 Sep 07 02:37:03 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Acquiring lock "cinder-07fcb1db-0668-4ce3-82f4-8f6edea4d943-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Lock "cinder-07fcb1db-0668-4ce3-82f4-8f6edea4d943-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Acquiring lock "cinder-quobyte-07fcb1db-0668-4ce3-82f4-8f6edea4d943" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Lock "cinder-quobyte-07fcb1db-0668-4ce3-82f4-8f6edea4d943" acquired by "delete_volume" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[658af621-4155-49be-9684-3ee1ff7387c1]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:03 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9915906b-50bb-41be-801d-5a8da3694ba3" returned: 0 in 0.290s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-9915906b-50bb-41be-801d-5a8da3694ba3" released by "delete_volume" :: held 0.754s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Created reservations ['3a2ad5d1-fd7b-432b-92a8-ead08a302091', 'd905c74a-ff24-4728-9d15-adaa8f168d4d', 'e26f177b-dfd4-4de5-b34a-011b0e66f3b3', '17fc629b-7a3b-4be3-8490-9b9ea2b4fff7'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:03 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943 Sep 07 02:37:03 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:03 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:03 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "cinder-a94abe07-711f-4fde-bc2f-ea14fe1e1e70-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-a94abe07-711f-4fde-bc2f-ea14fe1e1e70-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "cinder-quobyte-a94abe07-711f-4fde-bc2f-ea14fe1e1e70" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "cinder-ef6d924e-4d5d-4c9c-b32d-5a4673900466-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:04 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943" returned: 0 in 0.490s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-quobyte-a94abe07-711f-4fde-bc2f-ea14fe1e1e70" acquired by "delete_volume" :: waited 0.052s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:04 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943 Sep 07 02:37:04 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:04 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-ef6d924e-4d5d-4c9c-b32d-5a4673900466-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb11b1-a4ea-46dc-b090-7e553d1b6917]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.370s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:04 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Deleted volume successfully. Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "cinder-quobyte-ef6d924e-4d5d-4c9c-b32d-5a4673900466" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a9e99486-9546-40dd-9e5c-5e6c87e60d53 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-9915906b-50bb-41be-801d-5a8da3694ba3-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-ef6d924e-4d5d-4c9c-b32d-5a4673900466" acquired by "delete_volume" :: waited 0.029s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfacb86-5c19-4e7e-aa92-aa3eb5d91bfd]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:04 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70 Sep 07 02:37:04 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:04 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 Sep 07 02:37:04 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:04 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-07fcb1db-0668-4ce3-82f4-8f6edea4d943" returned: 0 in 0.341s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Lock "cinder-quobyte-07fcb1db-0668-4ce3-82f4-8f6edea4d943" released by "delete_volume" :: held 0.882s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Created reservations ['1fede44b-924f-41cc-8401-39474d3d4f80', 'f7f8e353-2fc3-472d-be15-2105b0704e1c', 'c0da35b8-c125-4e61-974b-c11a99cda96f', '752133c2-ea9a-432e-a670-2e69feaa0cd1'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:04 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:04 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:04 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70" returned: 0 in 0.564s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:04 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70 Sep 07 02:37:04 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:04 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466" returned: 0 in 0.552s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:04 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466 Sep 07 02:37:04 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:05 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.490s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Deleted volume successfully. Sep 07 02:37:05 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-a94abe07-711f-4fde-bc2f-ea14fe1e1e70" returned: 0 in 0.453s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-quobyte-a94abe07-711f-4fde-bc2f-ea14fe1e1e70" released by "delete_volume" :: held 1.114s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2a997606-9c37-414f-96d9-974939b1d612 tempest-ProjectReaderTests-2040663305 None] Lock "cinder-07fcb1db-0668-4ce3-82f4-8f6edea4d943-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Created reservations ['2fc11257-fb08-4687-9760-1b396ff68a89', '3ef39649-9eb4-431f-9f31-d36b697cb6c5', '1d784c76-5036-49be-9985-0c90cec673e4', '65db9387-910f-4018-a4da-195cb4f80816'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:05 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-ef6d924e-4d5d-4c9c-b32d-5a4673900466" returned: 0 in 0.516s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-quobyte-ef6d924e-4d5d-4c9c-b32d-5a4673900466" released by "delete_volume" :: held 1.140s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:37:05 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:05 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Flow 'volume_create_manager' (184e6cea-8495-418e-89d3-4c02ab8d112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae6b553-5fc7-4c07-970f-80c5560306fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Created reservations ['89d989c4-a485-4afa-a70e-006f7634f611', 'e19445b9-f6a0-4c1b-ba9a-a70313577cc0', 'd9e97337-28c1-4196-9b82-4ba0c2ce4cca', '4c458523-c8ab-4719-af2f-79e622a6a813'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae6b553-5fc7-4c07-970f-80c5560306fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648409722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45388c06-9e26-45b4-b137-2da029ef7589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631bc1801c7a4871b6f3a9849d1d6697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:06Z,use_quota=True,user_id='07e30d74f6a2421b9c3a760f5cd7da60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f251be28-9d8b-4d18-bf84-6c363f6114dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f251be28-9d8b-4d18-bf84-6c363f6114dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8df5925-adb7-458c-b891-2c603d2b94d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8df5925-adb7-458c-b891-2c603d2b94d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45388c06-9e26-45b4-b137-2da029ef7589', 'volume_name': 'volume-45388c06-9e26-45b4-b137-2da029ef7589', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7b7e8c-2931-47f2-9d36-cf5f7db16403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7b7e8c-2931-47f2-9d36-cf5f7db16403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c46dad-496b-4e16-868c-33871cb4c9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:05 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Volume 45388c06-9e26-45b4-b137-2da029ef7589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45388c06-9e26-45b4-b137-2da029ef7589', 'volume_size': 1} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648409722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45388c06-9e26-45b4-b137-2da029ef7589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='631bc1801c7a4871b6f3a9849d1d6697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:06Z,use_quota=True,user_id='07e30d74f6a2421b9c3a760f5cd7da60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Creating volume 45388c06-9e26-45b4-b137-2da029ef7589 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:37:05 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:05 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589 1073741824 Sep 07 02:37:05 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:05 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.291s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Deleted volume successfully. Sep 07 02:37:05 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:05 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-8d84f9d8-c00e-4cc4-b05e-b482a6a87ec4 tempest-ProjectReaderTests-2056874709 None] Lock "cinder-a94abe07-711f-4fde-bc2f-ea14fe1e1e70-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:06 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.294s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:06 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Deleted volume successfully. Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1068d78f-d1db-492e-9617-d17788748fd4 tempest-SnapshotDependencyTests-955237384 None] Lock "cinder-ef6d924e-4d5d-4c9c-b32d-5a4673900466-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:06 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589 1073741824" returned: 0 in 0.495s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:06 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589 Sep 07 02:37:06 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:06 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589" returned: 0 in 0.311s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c46dad-496b-4e16-868c-33871cb4c9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45388c06-9e26-45b4-b137-2da029ef7589', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63eedd0-ca5f-478d-9cf4-e30a8e3326fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:06 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Volume volume-45388c06-9e26-45b4-b137-2da029ef7589 (45388c06-9e26-45b4-b137-2da029ef7589): created successfully Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63eedd0-ca5f-478d-9cf4-e30a8e3326fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Flow 'volume_create_manager' (184e6cea-8495-418e-89d3-4c02ab8d112c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:06 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2e70eb9b-c287-40d5-837e-e3ddf56beecb tempest-ProjectReaderTests-2040663305 None] Created volume successfully. Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Flow 'volume_create_manager' (3c59fb91-f49d-4d7e-aeef-f3851cc880ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c536bdd-8fae-4cbb-b8a7-bea546e82787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c536bdd-8fae-4cbb-b8a7-bea546e82787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299830118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da8b801-e482-49cd-9865-5c54bc46a5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd70b9eb3fe94530b82ac90118cc6d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:07Z,use_quota=True,user_id='4086e873c720489abb57f4c3a6516efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee9a19f-2a87-4e59-b2f3-a131c77d0a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee9a19f-2a87-4e59-b2f3-a131c77d0a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed81a977-16ed-4dd4-beb0-36ad77efc624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed81a977-16ed-4dd4-beb0-36ad77efc624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da8b801-e482-49cd-9865-5c54bc46a5a4', 'volume_name': 'volume-4da8b801-e482-49cd-9865-5c54bc46a5a4', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:06 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c699691-7941-44e3-81b9-18a3e7bf262e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c699691-7941-44e3-81b9-18a3e7bf262e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0adbc3b-9b6f-4c8f-8494-d7ce29457a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:07 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Volume 4da8b801-e482-49cd-9865-5c54bc46a5a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da8b801-e482-49cd-9865-5c54bc46a5a4', 'volume_size': 1} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299830118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da8b801-e482-49cd-9865-5c54bc46a5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd70b9eb3fe94530b82ac90118cc6d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:07Z,use_quota=True,user_id='4086e873c720489abb57f4c3a6516efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Creating volume 4da8b801-e482-49cd-9865-5c54bc46a5a4 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:37:07 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:07 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4 1073741824 Sep 07 02:37:07 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:07 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4 1073741824" returned: 0 in 0.519s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:07 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4 Sep 07 02:37:07 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Acquiring lock "cinder-45388c06-9e26-45b4-b137-2da029ef7589-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Lock "cinder-45388c06-9e26-45b4-b137-2da029ef7589-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Acquiring lock "cinder-quobyte-45388c06-9e26-45b4-b137-2da029ef7589" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Lock "cinder-quobyte-45388c06-9e26-45b4-b137-2da029ef7589" acquired by "delete_volume" :: waited 0.027s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:07 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4" returned: 0 in 0.339s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0adbc3b-9b6f-4c8f-8494-d7ce29457a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da8b801-e482-49cd-9865-5c54bc46a5a4', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82aa95ca-7021-4ad9-8222-e6b5e0ce496e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dda2cfe-2605-4267-a233-4919fd926f76]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:07 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Volume volume-4da8b801-e482-49cd-9865-5c54bc46a5a4 (4da8b801-e482-49cd-9865-5c54bc46a5a4): created successfully Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82aa95ca-7021-4ad9-8222-e6b5e0ce496e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Flow 'volume_create_manager' (3c59fb91-f49d-4d7e-aeef-f3851cc880ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:08 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-49dbc0dd-8b2d-4244-90b5-12159c6b80ec tempest-ProjectReaderTests-2056874709 None] Created volume successfully. Sep 07 02:37:08 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589 Sep 07 02:37:08 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:08 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589" returned: 0 in 0.436s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:08 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589 Sep 07 02:37:08 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (5af72165-9a59-4398-85eb-d8225abac1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942323b4-33d2-413c-bccb-b6cdc39f7658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942323b4-33d2-413c-bccb-b6cdc39f7658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1033409014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:08Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2f2e26-ee52-4df1-a001-a34e9dad07e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2f2e26-ee52-4df1-a001-a34e9dad07e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe323fd6-5ffc-4c80-b1dd-a6f3ac5aa56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe323fd6-5ffc-4c80-b1dd-a6f3ac5aa56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a', 'volume_name': 'volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecd5382-13bb-4aeb-adaf-d57b936775cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecd5382-13bb-4aeb-adaf-d57b936775cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731fb6ea-b2a0-4085-bc6d-7628d63a429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:08 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Volume 8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a', 'volume_size': 1} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1033409014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:08Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Creating volume 8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:37:08 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:08 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a 1073741824 Sep 07 02:37:08 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:08 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-45388c06-9e26-45b4-b137-2da029ef7589" returned: 0 in 0.268s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Lock "cinder-quobyte-45388c06-9e26-45b4-b137-2da029ef7589" released by "delete_volume" :: held 0.765s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Created reservations ['c92e4f72-3fe0-4cd3-a114-46a8c1d64239', '1e128fec-289c-4a22-b6d3-64dbdd814390', '054081af-90f5-4f4b-84bc-aedaf37877f4', '6402d98f-d43e-4ea1-bdc6-b16a67345d12'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:08 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:08 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:09 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.316s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:09 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Deleted volume successfully. Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Acquiring lock "cinder-4da8b801-e482-49cd-9865-5c54bc46a5a4-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:09 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a 1073741824" returned: 0 in 0.620s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Lock "cinder-4da8b801-e482-49cd-9865-5c54bc46a5a4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-03f52714-14b0-47c7-9d4e-4f9bc5dace1c tempest-ProjectReaderTests-2040663305 None] Lock "cinder-45388c06-9e26-45b4-b137-2da029ef7589-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Acquiring lock "cinder-quobyte-4da8b801-e482-49cd-9865-5c54bc46a5a4" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Lock "cinder-quobyte-4da8b801-e482-49cd-9865-5c54bc46a5a4" acquired by "delete_volume" :: waited 0.032s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:09 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a Sep 07 02:37:09 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70fd8bc-61a0-4d92-a83c-276a0b57f950]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:09 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4 Sep 07 02:37:09 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:09 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a" returned: 0 in 0.387s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731fb6ea-b2a0-4085-bc6d-7628d63a429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7097fe9-d563-4def-b8ce-0ae6c94d2a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:09 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Volume volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a (8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a): created successfully Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7097fe9-d563-4def-b8ce-0ae6c94d2a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (5af72165-9a59-4398-85eb-d8225abac1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:09 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a4e6520b-a22f-4a1e-9be7-a4b9f759422c tempest-ProjectMemberTests-294561659 None] Created volume successfully. Sep 07 02:37:09 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4" returned: 0 in 0.474s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:09 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4 Sep 07 02:37:09 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:10 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-4da8b801-e482-49cd-9865-5c54bc46a5a4" returned: 0 in 0.287s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Lock "cinder-quobyte-4da8b801-e482-49cd-9865-5c54bc46a5a4" released by "delete_volume" :: held 0.831s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Created reservations ['de259417-245d-44f7-9bf7-3f394724c802', '97e1991e-a9f4-4d26-8aa9-10019a77b55c', 'c9cf5984-99df-4e0b-ab0b-bcc0be6c4d10', 'e8113c74-d4f0-4cc1-b93d-d4a86096aa9c'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:10 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:10 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:10 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.417s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Deleted volume successfully. Sep 07 02:37:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-b9db5cd7-da43-449c-b4de-c6e95eb7047c tempest-ProjectReaderTests-2056874709 None] Lock "cinder-4da8b801-e482-49cd-9865-5c54bc46a5a4-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] Creating offline snapshot f75c67d9-1294-455d-86cb-5ad45905c78c of volume 8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:37:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f632452-5094-4eb3-8103-28b69ece364f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:11 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a Sep 07 02:37:11 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:11 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a" returned: 0 in 0.453s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:11 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c 1G Sep 07 02:37:11 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:12 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c 1G" returned: 0 in 0.497s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:12 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c Sep 07 02:37:12 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:12 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c" returned: 0 in 0.365s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:12 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c is being set with open permissions: ugo+rw Sep 07 02:37:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:12 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c Sep 07 02:37:12 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:13 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c" returned: 0 in 0.269s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:13 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.info Sep 07 02:37:13 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:13 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.info" returned: 0 in 0.272s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:13 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.info is being set with open permissions: ugo+rw Sep 07 02:37:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:13 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.info Sep 07 02:37:13 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:13 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.info" returned: 0 in 0.260s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7953c56c-ba78-438c-a3ce-8ecbda14e5c1 tempest-ProjectMemberTests-294561659 None] Create snapshot completed successfully Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-f75c67d9-1294-455d-86cb-5ad45905c78c-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Lock "cinder-f75c67d9-1294-455d-86cb-5ad45905c78c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-f75c67d9-1294-455d-86cb-5ad45905c78c" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-f75c67d9-1294-455d-86cb-5ad45905c78c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Deleting offline snapshot f75c67d9-1294-455d-86cb-5ad45905c78c of volume 8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] snapshot_file for this snap is: volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e43927e-be7d-464e-bb78-6b6ef97f8185]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:14 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c Sep 07 02:37:14 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:14 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c" returned: 0 in 0.363s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:14 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:37:15 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec495a09-54c0-4460-949a-a9c07b40451c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:15 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a Sep 07 02:37:15 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:15 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a" returned: 0 in 0.396s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:15 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c Sep 07 02:37:15 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:15 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c" returned: 0 in 0.391s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:15 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:15 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c Sep 07 02:37:15 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:16 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a.f75c67d9-1294-455d-86cb-5ad45905c78c" returned: 0 in 0.269s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-f75c67d9-1294-455d-86cb-5ad45905c78c" released by "_delete_snapshot" :: held 1.571s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a" released by "delete_snapshot" :: held 1.600s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:16 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Created reservations ['30f74573-fa18-40b6-806b-876daea0e76c', '01d4c8c9-63f5-4580-98e0-893a1cb103de', '9f938616-3af3-47e4-ac19-b5ab760af834', 'dcee0873-305a-4491-9981-3e35c01e4eef'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:16 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Delete snapshot completed successfully. Sep 07 02:37:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-42788bab-c2c9-4e8a-b5df-b0ba0859e872 tempest-ProjectMemberTests-294561659 None] Lock "cinder-f75c67d9-1294-455d-86cb-5ad45905c78c-delete_snapshot" released by "delete_snapshot" :: held 1.765s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:16 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a" acquired by "delete_volume" :: waited 0.022s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:16 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[7279e1a6-e915-44b4-8813-573022432b43]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:16 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:16 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a Sep 07 02:37:16 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:17 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a" returned: 0 in 0.387s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:17 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a Sep 07 02:37:17 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:17 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a" returned: 0 in 0.263s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a" released by "delete_volume" :: held 0.711s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Created reservations ['a90968b9-7a5e-4ccc-ad39-67cb4d929b0d', '2562563d-a7ae-4d9a-9d0a-b7386694ecca', 'fea59363-41c4-44a8-a705-121c79cb4a68', '6e045d48-2a4a-4299-a2bf-4436d0fb81e5'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:17 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:17 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:17 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.260s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:17 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Deleted volume successfully. Sep 07 02:37:17 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-294cdaac-7a22-442e-8b4e-443e947c95f1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-8fcbb231-2e0a-4ae2-8a3d-7dcac432bb1a-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (1bd50974-b058-4553-8036-2a4acaf53c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570f9489-5f6f-4b37-b45f-b0c8421676a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570f9489-5f6f-4b37-b45f-b0c8421676a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433372810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ca01cb-26e0-4122-b4f7-8870275e8988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:18Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cac366-b2bc-4553-9959-6f7e43430bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cac366-b2bc-4553-9959-6f7e43430bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba2a5b7-c3ee-43f0-a7ab-354c0028d318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba2a5b7-c3ee-43f0-a7ab-354c0028d318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ca01cb-26e0-4122-b4f7-8870275e8988', 'volume_name': 'volume-f2ca01cb-26e0-4122-b4f7-8870275e8988', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83b1b04-1438-4285-8d9f-3586745fdd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83b1b04-1438-4285-8d9f-3586745fdd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6251cbf9-a924-4f55-96c1-88a587e7e3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:18 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Volume f2ca01cb-26e0-4122-b4f7-8870275e8988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ca01cb-26e0-4122-b4f7-8870275e8988', 'volume_size': 1} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433372810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ca01cb-26e0-4122-b4f7-8870275e8988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:18Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Creating volume f2ca01cb-26e0-4122-b4f7-8870275e8988 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:37:18 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:18 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 1073741824 Sep 07 02:37:18 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:18 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 1073741824" returned: 0 in 0.401s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:18 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 Sep 07 02:37:18 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:19 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988" returned: 0 in 0.248s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6251cbf9-a924-4f55-96c1-88a587e7e3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ca01cb-26e0-4122-b4f7-8870275e8988', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e688cb53-74b3-4b90-b601-30e4fdb35b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:19 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Volume volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 (f2ca01cb-26e0-4122-b4f7-8870275e8988): created successfully Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e688cb53-74b3-4b90-b601-30e4fdb35b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (1bd50974-b058-4553-8036-2a4acaf53c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:19 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-48f252e5-97ae-46f5-88d3-080a1c8d4ef4 tempest-ProjectMemberTests-294561659 None] Created volume successfully. Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] Creating offline snapshot aae26311-95be-4999-814c-49f89bb88d54 of volume f2ca01cb-26e0-4122-b4f7-8870275e8988 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e8c0e9-324a-44a8-8e80-d77637106a0e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:19 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 Sep 07 02:37:19 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:19 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988" returned: 0 in 0.355s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:19 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 1G Sep 07 02:37:19 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:20 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 1G" returned: 0 in 0.375s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:20 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 Sep 07 02:37:20 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:20 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54" returned: 0 in 0.293s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:20 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 is being set with open permissions: ugo+rw Sep 07 02:37:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:20 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 Sep 07 02:37:20 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:20 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:20 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.info Sep 07 02:37:20 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:21 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.info" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:21 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.info is being set with open permissions: ugo+rw Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:21 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.info Sep 07 02:37:21 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:21 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.info" returned: 0 in 0.251s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:21 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-f7057941-423f-4842-8746-f55d1490dbb4 tempest-ProjectMemberTests-294561659 None] Create snapshot completed successfully Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-aae26311-95be-4999-814c-49f89bb88d54-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Lock "cinder-aae26311-95be-4999-814c-49f89bb88d54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-f2ca01cb-26e0-4122-b4f7-8870275e8988" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-f2ca01cb-26e0-4122-b4f7-8870275e8988" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-aae26311-95be-4999-814c-49f89bb88d54" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-aae26311-95be-4999-814c-49f89bb88d54" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Deleting offline snapshot aae26311-95be-4999-814c-49f89bb88d54 of volume f2ca01cb-26e0-4122-b4f7-8870275e8988 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] snapshot_file for this snap is: volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc533c5-42b9-4289-b62e-6e616921c9f3]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:21 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 Sep 07 02:37:21 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:22 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54" returned: 0 in 0.355s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:22 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2ca01cb-26e0-4122-b4f7-8870275e8988(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:37:22 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[1652d31f-c10e-48f0-ba43-6a9ea76cab99]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:22 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 Sep 07 02:37:22 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:22 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988" returned: 0 in 0.357s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:22 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 Sep 07 02:37:22 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:22 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54" returned: 0 in 0.329s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:22 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54 Sep 07 02:37:22 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:22 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988.aae26311-95be-4999-814c-49f89bb88d54" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-aae26311-95be-4999-814c-49f89bb88d54" released by "_delete_snapshot" :: held 1.380s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-f2ca01cb-26e0-4122-b4f7-8870275e8988" released by "delete_snapshot" :: held 1.402s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:23 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Created reservations ['fc053b8b-bbab-40e1-b53a-6fbc2405927a', 'aae92da1-e56d-4335-b14c-26f4204dfe22', '3a8fcf8a-b4da-41c4-b2fd-e0353ce8fdf7', 'be0a0183-4320-48e9-83bb-fc5824ca9d94'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:23 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Delete snapshot completed successfully. Sep 07 02:37:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0e940380-4c96-40b7-b142-47808ed3a974 tempest-ProjectMemberTests-294561659 None] Lock "cinder-aae26311-95be-4999-814c-49f89bb88d54-delete_snapshot" released by "delete_snapshot" :: held 1.531s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-f2ca01cb-26e0-4122-b4f7-8870275e8988-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Lock "cinder-f2ca01cb-26e0-4122-b4f7-8870275e8988-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-f2ca01cb-26e0-4122-b4f7-8870275e8988" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-f2ca01cb-26e0-4122-b4f7-8870275e8988" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:23 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[978eff77-6320-478e-8376-effc00aad02b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:23 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 Sep 07 02:37:23 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:24 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988" returned: 0 in 0.355s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:24 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988 Sep 07 02:37:24 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:24 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-f2ca01cb-26e0-4122-b4f7-8870275e8988" returned: 0 in 0.260s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-f2ca01cb-26e0-4122-b4f7-8870275e8988" released by "delete_volume" :: held 0.668s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Created reservations ['9d327225-810c-41c8-9a28-8c31a2074e69', '841ea3c5-f03f-4a7c-88e2-1fda3b984287', '13428db6-d7a6-46d6-89d6-35a54120ad2e', '9ec0b38c-df43-4c1d-b8a8-cfa2d8e4e337'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:24 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:24 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:24 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:24 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Deleted volume successfully. Sep 07 02:37:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-0c3332a6-1eeb-4413-b36b-903b120a5301 tempest-ProjectMemberTests-294561659 None] Lock "cinder-f2ca01cb-26e0-4122-b4f7-8870275e8988-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (060b6a87-694d-4236-93aa-0e642d448e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95672ec4-1ce4-4b4a-81aa-13269e330dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95672ec4-1ce4-4b4a-81aa-13269e330dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580432698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0681ab3-4321-4eed-8028-ceeb6bcd859c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:25Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcbf4e8-c554-4609-b804-ec1662727619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcbf4e8-c554-4609-b804-ec1662727619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798b52ac-f23d-4237-93de-80d8ce911537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798b52ac-f23d-4237-93de-80d8ce911537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0681ab3-4321-4eed-8028-ceeb6bcd859c', 'volume_name': 'volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cec77d1-9c8f-4e2c-9974-36a7f7a67d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cec77d1-9c8f-4e2c-9974-36a7f7a67d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6fa987-caed-4034-aee4-d16f1bef6930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:25 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Volume e0681ab3-4321-4eed-8028-ceeb6bcd859c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c', 'volume_size': 1} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580432698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0681ab3-4321-4eed-8028-ceeb6bcd859c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:25Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Creating volume e0681ab3-4321-4eed-8028-ceeb6bcd859c {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:37:25 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:25 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c 1073741824 Sep 07 02:37:25 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:25 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c 1073741824" returned: 0 in 0.401s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:25 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c Sep 07 02:37:25 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:26 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c" returned: 0 in 0.256s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6fa987-caed-4034-aee4-d16f1bef6930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265b07a8-b951-44e5-a9d6-a2987045b274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:26 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Volume volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c (e0681ab3-4321-4eed-8028-ceeb6bcd859c): created successfully Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265b07a8-b951-44e5-a9d6-a2987045b274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (060b6a87-694d-4236-93aa-0e642d448e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:26 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-10be1a41-d8a1-4f9e-8f6f-13d73e431f7b tempest-ProjectMemberTests-294561659 None] Created volume successfully. Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:26 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:26 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:26 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] Creating offline snapshot 17258f61-d4d3-4849-8379-ab832484401f of volume e0681ab3-4321-4eed-8028-ceeb6bcd859c {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f494e04-4149-40d7-9e12-02dcac953fb8]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:26 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c Sep 07 02:37:26 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:26 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c" returned: 0 in 0.350s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:26 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f 1G Sep 07 02:37:26 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:27 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f 1G" returned: 0 in 0.371s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:27 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f Sep 07 02:37:27 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:27 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f" returned: 0 in 0.282s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:27 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f is being set with open permissions: ugo+rw Sep 07 02:37:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:27 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f Sep 07 02:37:27 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:27 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:27 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.info Sep 07 02:37:27 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:28 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.info" returned: 0 in 0.244s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:28 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.info is being set with open permissions: ugo+rw Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:28 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.info Sep 07 02:37:28 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:28 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.info" returned: 0 in 0.254s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:28 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4c635981-46ef-44b5-bb3e-c03e442f1367 tempest-ProjectMemberTests-294561659 None] Create snapshot completed successfully Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-17258f61-d4d3-4849-8379-ab832484401f-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Lock "cinder-17258f61-d4d3-4849-8379-ab832484401f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-e0681ab3-4321-4eed-8028-ceeb6bcd859c" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-e0681ab3-4321-4eed-8028-ceeb6bcd859c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-17258f61-d4d3-4849-8379-ab832484401f" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-17258f61-d4d3-4849-8379-ab832484401f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Deleting offline snapshot 17258f61-d4d3-4849-8379-ab832484401f of volume e0681ab3-4321-4eed-8028-ceeb6bcd859c {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] snapshot_file for this snap is: volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[1117c8a6-c111-4aba-8c4e-dfd2b8cecb04]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:28 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f Sep 07 02:37:28 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:29 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f" returned: 0 in 0.361s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:29 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:37:29 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc69cf3-6076-412b-ab34-e9720460e417]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:29 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c Sep 07 02:37:29 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:29 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c" returned: 0 in 0.345s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:29 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f Sep 07 02:37:29 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:29 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f" returned: 0 in 0.320s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:29 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f Sep 07 02:37:29 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:30 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c.17258f61-d4d3-4849-8379-ab832484401f" returned: 0 in 0.244s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-17258f61-d4d3-4849-8379-ab832484401f" released by "_delete_snapshot" :: held 1.353s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-e0681ab3-4321-4eed-8028-ceeb6bcd859c" released by "delete_snapshot" :: held 1.374s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:30 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Created reservations ['d19c8a9c-c762-4b07-8c2e-ee9b7d3693f1', '16aba1ea-8d0d-4dc2-b319-232bbf1fdb35', 'f663a23c-902e-4f67-901e-aecefda8e2cf', 'b79eb69c-ecd1-4ac0-a33b-f25be6c051dd'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:30 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Delete snapshot completed successfully. Sep 07 02:37:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a7ca802e-23f4-4532-b27b-2c1c64d2ed0a tempest-ProjectMemberTests-294561659 None] Lock "cinder-17258f61-d4d3-4849-8379-ab832484401f-delete_snapshot" released by "delete_snapshot" :: held 1.499s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-e0681ab3-4321-4eed-8028-ceeb6bcd859c-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Lock "cinder-e0681ab3-4321-4eed-8028-ceeb6bcd859c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-e0681ab3-4321-4eed-8028-ceeb6bcd859c" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-e0681ab3-4321-4eed-8028-ceeb6bcd859c" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:30 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e7c58b-2ab8-441f-a77b-4c33c825ad8f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:31 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c Sep 07 02:37:31 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:31 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c" returned: 0 in 0.350s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:31 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c Sep 07 02:37:31 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:31 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-e0681ab3-4321-4eed-8028-ceeb6bcd859c" returned: 0 in 0.253s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-e0681ab3-4321-4eed-8028-ceeb6bcd859c" released by "delete_volume" :: held 0.655s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Created reservations ['880b46e9-f95b-42c4-9965-f9b815d220bd', 'a9f1241d-4cfd-47ae-8c91-51ff11634675', 'dd305ee5-c1eb-430f-bc30-f7822c6541e8', '19e1e51b-3481-444a-a128-9a417e29bcfa'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:31 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:31 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:31 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Deleted volume successfully. Sep 07 02:37:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2e4c7730-6b26-44cc-bc17-51177ea5ea0f tempest-ProjectMemberTests-294561659 None] Lock "cinder-e0681ab3-4321-4eed-8028-ceeb6bcd859c-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (0ec2f93e-44a0-4986-b59e-f56755e9134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6917ed-58f2-427e-a3fb-3e52648f5dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6917ed-58f2-427e-a3fb-3e52648f5dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760445368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3e32b8-ea0d-4440-a459-d359c40462eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:32Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7346394c-34fc-4a9d-9305-77c15b7f63eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7346394c-34fc-4a9d-9305-77c15b7f63eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd68774c-b0ab-4012-a2bf-cca8c8dc7026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd68774c-b0ab-4012-a2bf-cca8c8dc7026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b3e32b8-ea0d-4440-a459-d359c40462eb', 'volume_name': 'volume-0b3e32b8-ea0d-4440-a459-d359c40462eb', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f307bc84-b077-4665-92c7-3f6db7fd4d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f307bc84-b077-4665-92c7-3f6db7fd4d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f6c995-8f8d-4326-9e6c-486d433a95b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:32 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Volume 0b3e32b8-ea0d-4440-a459-d359c40462eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b3e32b8-ea0d-4440-a459-d359c40462eb', 'volume_size': 1} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760445368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3e32b8-ea0d-4440-a459-d359c40462eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:32Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Creating volume 0b3e32b8-ea0d-4440-a459-d359c40462eb {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:37:32 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:32 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb 1073741824 Sep 07 02:37:32 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:32 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb 1073741824" returned: 0 in 0.400s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:32 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb Sep 07 02:37:32 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:33 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f6c995-8f8d-4326-9e6c-486d433a95b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3e32b8-ea0d-4440-a459-d359c40462eb', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be437558-98c8-40e6-9cae-653563484f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:33 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Volume volume-0b3e32b8-ea0d-4440-a459-d359c40462eb (0b3e32b8-ea0d-4440-a459-d359c40462eb): created successfully Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be437558-98c8-40e6-9cae-653563484f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (0ec2f93e-44a0-4986-b59e-f56755e9134b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:33 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b3a95369-74e3-4219-b969-822545759bfd tempest-ProjectMemberTests-294561659 None] Created volume successfully. Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] Creating offline snapshot bf0a8a4a-47c2-4393-8920-e820acbfe9fa of volume 0b3e32b8-ea0d-4440-a459-d359c40462eb {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[168b773b-a473-4af4-928c-0b381250376e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:33 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb Sep 07 02:37:33 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:33 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb" returned: 0 in 0.349s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:33 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa 1G Sep 07 02:37:33 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:34 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa 1G" returned: 0 in 0.384s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3e32b8-ea0d-4440-a459-d359c40462eb -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:34 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3e32b8-ea0d-4440-a459-d359c40462eb -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa Sep 07 02:37:34 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:34 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b3e32b8-ea0d-4440-a459-d359c40462eb -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa" returned: 0 in 0.293s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:34 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa is being set with open permissions: ugo+rw Sep 07 02:37:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:34 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa Sep 07 02:37:34 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:34 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:34 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.info Sep 07 02:37:34 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:35 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.info" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:35 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.info is being set with open permissions: ugo+rw Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:35 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.info Sep 07 02:37:35 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:35 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.info" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:35 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-9e4a90fd-a473-43e6-9f03-661d0e2cbd6f tempest-ProjectMemberTests-294561659 None] Create snapshot completed successfully Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-bf0a8a4a-47c2-4393-8920-e820acbfe9fa-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Lock "cinder-bf0a8a4a-47c2-4393-8920-e820acbfe9fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-0b3e32b8-ea0d-4440-a459-d359c40462eb" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-0b3e32b8-ea0d-4440-a459-d359c40462eb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-bf0a8a4a-47c2-4393-8920-e820acbfe9fa" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-bf0a8a4a-47c2-4393-8920-e820acbfe9fa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Deleting offline snapshot bf0a8a4a-47c2-4393-8920-e820acbfe9fa of volume 0b3e32b8-ea0d-4440-a459-d359c40462eb {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] snapshot_file for this snap is: volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9994577-6e6e-4875-995e-f20b8033db1c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:35 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa Sep 07 02:37:35 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:36 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa" returned: 0 in 0.351s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:36 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b3e32b8-ea0d-4440-a459-d359c40462eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:37:36 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f16da6-58df-4f2e-b8e7-c921d9ab9b3a]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:36 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb Sep 07 02:37:36 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:36 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb" returned: 0 in 0.345s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:36 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa Sep 07 02:37:36 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:36 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa" returned: 0 in 0.333s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:36 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa Sep 07 02:37:36 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:37 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb.bf0a8a4a-47c2-4393-8920-e820acbfe9fa" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-bf0a8a4a-47c2-4393-8920-e820acbfe9fa" released by "_delete_snapshot" :: held 1.360s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-0b3e32b8-ea0d-4440-a459-d359c40462eb" released by "delete_snapshot" :: held 1.382s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:37 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Created reservations ['9f517cfb-3b10-4931-8bd6-28d11f344d99', '2167aa23-396c-4daf-a917-1403c94dfbc9', '2c2f2238-8752-45f4-ac52-9b8665732228', '690047ea-8682-40fa-89cc-e6bb10ce89de'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:37 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Delete snapshot completed successfully. Sep 07 02:37:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-fa795253-c869-4c5f-aa89-df93bb79f3ad tempest-ProjectMemberTests-294561659 None] Lock "cinder-bf0a8a4a-47c2-4393-8920-e820acbfe9fa-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-0b3e32b8-ea0d-4440-a459-d359c40462eb-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-0b3e32b8-ea0d-4440-a459-d359c40462eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-0b3e32b8-ea0d-4440-a459-d359c40462eb" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-0b3e32b8-ea0d-4440-a459-d359c40462eb" acquired by "delete_volume" :: waited 0.012s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:37 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5cbef0-5ac7-43c6-bb98-347068cb4a5d]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:37 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb Sep 07 02:37:37 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:38 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb" returned: 0 in 0.354s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:38 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb Sep 07 02:37:38 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:38 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-0b3e32b8-ea0d-4440-a459-d359c40462eb" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-0b3e32b8-ea0d-4440-a459-d359c40462eb" released by "delete_volume" :: held 0.651s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Created reservations ['4e8b9c7a-0f97-412d-aaa5-8744c6c684af', 'bded071e-1b31-4f44-8de1-7eca65c03bd3', '700d0807-40ef-4c1f-bfbf-d7c3e761ea48', '0b114b23-069e-464f-aeea-ea513abbc3b2'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:38 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:38 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:38 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.235s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Deleted volume successfully. Sep 07 02:37:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-2afb8933-14ef-4f00-800d-a014b98d2bb1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-0b3e32b8-ea0d-4440-a459-d359c40462eb-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (f25490ca-0c14-4fdd-85f1-f2865494f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a883e413-d656-40b7-931c-894dcc205b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a883e413-d656-40b7-931c-894dcc205b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226957285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e638da-a944-4251-93af-30e301960f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:39Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db5a23e-4b27-4302-9c8e-0c932745baa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db5a23e-4b27-4302-9c8e-0c932745baa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06443bdf-88fe-45a1-b6c1-78c030cfce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06443bdf-88fe-45a1-b6c1-78c030cfce67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8e638da-a944-4251-93af-30e301960f52', 'volume_name': 'volume-c8e638da-a944-4251-93af-30e301960f52', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c4109f-2257-4d86-ac82-0fb437c84c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c4109f-2257-4d86-ac82-0fb437c84c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9388d5-e6d0-4249-be65-4d29e1e73b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:39 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Volume c8e638da-a944-4251-93af-30e301960f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8e638da-a944-4251-93af-30e301960f52', 'volume_size': 1} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226957285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e638da-a944-4251-93af-30e301960f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:39Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Creating volume c8e638da-a944-4251-93af-30e301960f52 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:37:39 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:39 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 1073741824 Sep 07 02:37:39 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:39 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 1073741824" returned: 0 in 0.394s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:39 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 Sep 07 02:37:39 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:40 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52" returned: 0 in 0.234s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9388d5-e6d0-4249-be65-4d29e1e73b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8e638da-a944-4251-93af-30e301960f52', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c71495-9532-47cd-9f0b-e90dd69a286b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:40 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Volume volume-c8e638da-a944-4251-93af-30e301960f52 (c8e638da-a944-4251-93af-30e301960f52): created successfully Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c71495-9532-47cd-9f0b-e90dd69a286b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (f25490ca-0c14-4fdd-85f1-f2865494f069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:40 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-79d1d515-9466-44c6-905c-7b30caa79cc3 tempest-ProjectMemberTests-294561659 None] Created volume successfully. Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] Creating offline snapshot 1c247dd7-bf96-44f8-9e45-7e8b0a7155ec of volume c8e638da-a944-4251-93af-30e301960f52 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8390bf4-c1a7-4105-a2a3-4c238df6e43e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:40 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 Sep 07 02:37:40 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:40 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52" returned: 0 in 0.353s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:40 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec 1G Sep 07 02:37:40 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:41 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec 1G" returned: 0 in 0.374s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8e638da-a944-4251-93af-30e301960f52 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:41 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8e638da-a944-4251-93af-30e301960f52 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec Sep 07 02:37:41 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:41 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8e638da-a944-4251-93af-30e301960f52 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec" returned: 0 in 0.281s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:41 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec is being set with open permissions: ugo+rw Sep 07 02:37:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:41 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec Sep 07 02:37:41 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:41 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec" returned: 0 in 0.250s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:41 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.info Sep 07 02:37:41 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:42 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.info" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:42 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.info is being set with open permissions: ugo+rw Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:42 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.info Sep 07 02:37:42 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:42 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.info" returned: 0 in 0.237s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:42 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-39c59a5b-effa-486b-a1ae-6357dd6b109a tempest-ProjectMemberTests-294561659 None] Create snapshot completed successfully Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-1c247dd7-bf96-44f8-9e45-7e8b0a7155ec-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Lock "cinder-1c247dd7-bf96-44f8-9e45-7e8b0a7155ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-c8e638da-a944-4251-93af-30e301960f52" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-c8e638da-a944-4251-93af-30e301960f52" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-1c247dd7-bf96-44f8-9e45-7e8b0a7155ec" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-1c247dd7-bf96-44f8-9e45-7e8b0a7155ec" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Deleting offline snapshot 1c247dd7-bf96-44f8-9e45-7e8b0a7155ec of volume c8e638da-a944-4251-93af-30e301960f52 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] snapshot_file for this snap is: volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4d006f-812b-47c5-a41a-28abe4e7d552]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:42 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec Sep 07 02:37:42 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:43 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec" returned: 0 in 0.345s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:43 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8e638da-a944-4251-93af-30e301960f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:37:43 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9a0e75-3c33-4c1d-9f74-3970cabee837]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:43 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 Sep 07 02:37:43 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:43 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52" returned: 0 in 0.346s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:43 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec Sep 07 02:37:43 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:43 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec" returned: 0 in 0.314s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:43 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec Sep 07 02:37:43 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:43 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52.1c247dd7-bf96-44f8-9e45-7e8b0a7155ec" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-1c247dd7-bf96-44f8-9e45-7e8b0a7155ec" released by "_delete_snapshot" :: held 1.327s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-c8e638da-a944-4251-93af-30e301960f52" released by "delete_snapshot" :: held 1.346s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:44 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Created reservations ['29a1a7bf-ea41-4080-95dd-5bb9494839af', '73c0f260-5339-4e5f-b0f5-1c46cce03db6', '9b2899a1-2931-459b-9978-59c2cce18b4f', '9d3f8c4b-cf03-4fce-9b2c-8ee6fd614ed7'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:44 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Delete snapshot completed successfully. Sep 07 02:37:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-47265de0-27e5-4ca7-803b-d58f979d58da tempest-ProjectMemberTests-294561659 None] Lock "cinder-1c247dd7-bf96-44f8-9e45-7e8b0a7155ec-delete_snapshot" released by "delete_snapshot" :: held 1.473s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-c8e638da-a944-4251-93af-30e301960f52-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Lock "cinder-c8e638da-a944-4251-93af-30e301960f52-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-c8e638da-a944-4251-93af-30e301960f52" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-c8e638da-a944-4251-93af-30e301960f52" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:44 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cc5770-efbf-40ca-854b-bc86768d5a30]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:44 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 Sep 07 02:37:44 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:45 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52" returned: 0 in 0.348s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:45 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52 Sep 07 02:37:45 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:45 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-c8e638da-a944-4251-93af-30e301960f52" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-c8e638da-a944-4251-93af-30e301960f52" released by "delete_volume" :: held 0.646s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:UPDATE=206,cinder:SELECT=148,cinder:INSERT=54,cinder:DELETE=12 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Created reservations ['f27f141f-c30e-4888-9a83-c1f0b6474cad', '2fc5926d-da38-4c3e-901b-8af0d3b8cd40', '33765d84-0a78-47fe-a2f3-62ac68a30398', '0873062b-709a-4650-a799-9a28f8cfa618'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:45 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:45 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:45 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.244s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:45 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Deleted volume successfully. Sep 07 02:37:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-85a30619-5333-43f4-9db2-cb199c70ec34 tempest-ProjectMemberTests-294561659 None] Lock "cinder-c8e638da-a944-4251-93af-30e301960f52-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (ad494fb3-2ab1-46e3-b7cd-cc56337890f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9227ba9e-9305-45fe-a8e3-bdea24bcec62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9227ba9e-9305-45fe-a8e3-bdea24bcec62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504325659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef614c5-620c-4b85-aedd-e25098637f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:46Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9913044-4fa6-4cbb-8a29-9ceef377687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9913044-4fa6-4cbb-8a29-9ceef377687c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5c9a8c-00bd-4035-b864-9d2de8303fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5c9a8c-00bd-4035-b864-9d2de8303fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef614c5-620c-4b85-aedd-e25098637f81', 'volume_name': 'volume-1ef614c5-620c-4b85-aedd-e25098637f81', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3718076-110c-44f8-8bea-6ef1b57daa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3718076-110c-44f8-8bea-6ef1b57daa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b836cf8-bb29-48e6-bd6c-8f3de5480d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:46 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Volume 1ef614c5-620c-4b85-aedd-e25098637f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef614c5-620c-4b85-aedd-e25098637f81', 'volume_size': 1} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504325659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef614c5-620c-4b85-aedd-e25098637f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:46Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Creating volume 1ef614c5-620c-4b85-aedd-e25098637f81 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:37:46 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:46 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 1073741824 Sep 07 02:37:46 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:46 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 1073741824" returned: 0 in 0.398s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:46 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 Sep 07 02:37:46 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:47 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81" returned: 0 in 0.253s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b836cf8-bb29-48e6-bd6c-8f3de5480d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef614c5-620c-4b85-aedd-e25098637f81', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799bfeda-a3e8-4114-8718-2181cb3e2f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:47 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Volume volume-1ef614c5-620c-4b85-aedd-e25098637f81 (1ef614c5-620c-4b85-aedd-e25098637f81): created successfully Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799bfeda-a3e8-4114-8718-2181cb3e2f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (ad494fb3-2ab1-46e3-b7cd-cc56337890f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:47 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-08991fca-c9fa-48fb-8de7-c71e60d28ec7 tempest-ProjectMemberTests-294561659 None] Created volume successfully. Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] Creating offline snapshot 6ad3431d-818b-409f-83ab-900ccefcfbe8 of volume 1ef614c5-620c-4b85-aedd-e25098637f81 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83d98cb-dd41-40d5-ab20-7455fd1e78f5]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:47 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 Sep 07 02:37:47 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:47 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81" returned: 0 in 0.351s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:47 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 1G Sep 07 02:37:47 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:48 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 1G" returned: 0 in 0.389s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ef614c5-620c-4b85-aedd-e25098637f81 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:48 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ef614c5-620c-4b85-aedd-e25098637f81 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 Sep 07 02:37:48 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:48 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ef614c5-620c-4b85-aedd-e25098637f81 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8" returned: 0 in 0.286s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:48 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 is being set with open permissions: ugo+rw Sep 07 02:37:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:48 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 Sep 07 02:37:48 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:48 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8" returned: 0 in 0.236s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:48 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.info Sep 07 02:37:48 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:49 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.info" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:49 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.info is being set with open permissions: ugo+rw Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:49 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.info Sep 07 02:37:49 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:49 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.info" returned: 0 in 0.232s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.811s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:49 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7195e42b-027d-4419-8e1f-d86410c074b9 tempest-ProjectMemberTests-294561659 None] Create snapshot completed successfully Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-6ad3431d-818b-409f-83ab-900ccefcfbe8-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-6ad3431d-818b-409f-83ab-900ccefcfbe8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-1ef614c5-620c-4b85-aedd-e25098637f81" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-1ef614c5-620c-4b85-aedd-e25098637f81" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-6ad3431d-818b-409f-83ab-900ccefcfbe8" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-6ad3431d-818b-409f-83ab-900ccefcfbe8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Deleting offline snapshot 6ad3431d-818b-409f-83ab-900ccefcfbe8 of volume 1ef614c5-620c-4b85-aedd-e25098637f81 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] snapshot_file for this snap is: volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfe92a6-418f-43a0-a913-716790fcc1f0]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:49 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 Sep 07 02:37:49 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:50 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8" returned: 0 in 0.341s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:50 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ef614c5-620c-4b85-aedd-e25098637f81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:37:50 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[6275ce37-7d46-4402-883c-0d8be2746b88]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:50 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 Sep 07 02:37:50 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:50 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81" returned: 0 in 0.369s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:50 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 Sep 07 02:37:50 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:50 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8" returned: 0 in 0.326s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:50 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8 Sep 07 02:37:50 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:50 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81.6ad3431d-818b-409f-83ab-900ccefcfbe8" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-6ad3431d-818b-409f-83ab-900ccefcfbe8" released by "_delete_snapshot" :: held 1.361s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-1ef614c5-620c-4b85-aedd-e25098637f81" released by "delete_snapshot" :: held 1.384s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:51 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Created reservations ['08815c8f-0423-4f76-adb9-789fa6ed1d37', '79061810-28e5-409d-9388-b1446e24adc6', 'dcfdb0fd-9767-4131-a423-78e427f86306', '11fa904a-dee3-44b3-b8d9-e74eaeb0737d'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:51 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Delete snapshot completed successfully. Sep 07 02:37:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-ff9015f6-22fb-45de-85fd-717d12f735a1 tempest-ProjectMemberTests-294561659 None] Lock "cinder-6ad3431d-818b-409f-83ab-900ccefcfbe8-delete_snapshot" released by "delete_snapshot" :: held 1.514s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-1ef614c5-620c-4b85-aedd-e25098637f81-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Lock "cinder-1ef614c5-620c-4b85-aedd-e25098637f81-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-1ef614c5-620c-4b85-aedd-e25098637f81" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-1ef614c5-620c-4b85-aedd-e25098637f81" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:51 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d87fc4f-afd7-4155-94c1-451110858544]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:51 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 Sep 07 02:37:51 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:52 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81" returned: 0 in 0.344s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:52 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81 Sep 07 02:37:52 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:52 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-1ef614c5-620c-4b85-aedd-e25098637f81" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-1ef614c5-620c-4b85-aedd-e25098637f81" released by "delete_volume" :: held 0.636s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Created reservations ['ebad95f1-67ba-408d-b5b1-f6c34d84d325', 'f118ff45-d12a-478d-ab3a-e45ff3885e03', '616e2548-5e08-4d9c-97da-aa50578d5692', 'c19ce014-9758-4e48-8e74-a90d2c1a5af9'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:52 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:52 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:52 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Deleted volume successfully. Sep 07 02:37:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5b21188a-229a-4988-910e-d1f3b4a36a87 tempest-ProjectMemberTests-294561659 None] Lock "cinder-1ef614c5-620c-4b85-aedd-e25098637f81-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (3fb09aeb-4796-4836-aacf-a7b23ce5f05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c7a22a-694b-4f84-8ed6-3eca853a8631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c7a22a-694b-4f84-8ed6-3eca853a8631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703683360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4a1bad-fd95-4b51-a52a-8d889e02167e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:53Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2e0b16-fc4e-40b7-bc86-ab446d90529e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2e0b16-fc4e-40b7-bc86-ab446d90529e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f13638-00b7-4bb8-91ec-a0fa3f6bb75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f13638-00b7-4bb8-91ec-a0fa3f6bb75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb4a1bad-fd95-4b51-a52a-8d889e02167e', 'volume_name': 'volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0086f39b-d5e9-4561-ac35-4f532ee2cbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0086f39b-d5e9-4561-ac35-4f532ee2cbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de695a6-b54b-4b3d-b547-f528ac92a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:53 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Volume fb4a1bad-fd95-4b51-a52a-8d889e02167e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e', 'volume_size': 1} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703683360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4a1bad-fd95-4b51-a52a-8d889e02167e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:37:53Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Creating volume fb4a1bad-fd95-4b51-a52a-8d889e02167e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:37:53 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:53 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e 1073741824 Sep 07 02:37:53 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:53 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e 1073741824" returned: 0 in 0.390s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:53 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:53 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e Sep 07 02:37:53 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:54 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e" returned: 0 in 0.249s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de695a6-b54b-4b3d-b547-f528ac92a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70c782b-344f-43fe-9235-3927181d13eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:37:54 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Volume volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e (fb4a1bad-fd95-4b51-a52a-8d889e02167e): created successfully Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70c782b-344f-43fe-9235-3927181d13eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (3fb09aeb-4796-4836-aacf-a7b23ce5f05c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:37:54 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-123f8b02-c1c5-468c-aaea-84830a095592 tempest-ProjectMemberTests-294561659 None] Created volume successfully. Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] Creating offline snapshot 40326051-dff2-49f7-9bf6-6071e6c6958c of volume fb4a1bad-fd95-4b51-a52a-8d889e02167e {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb7fed8-c13a-4fb6-9e6c-c03eb13cfcbf]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:54 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e Sep 07 02:37:54 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:54 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e" returned: 0 in 0.364s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:54 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:54 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c 1G Sep 07 02:37:54 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:55 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c 1G" returned: 0 in 0.374s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:55 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c Sep 07 02:37:55 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:55 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c" returned: 0 in 0.296s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:55 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c is being set with open permissions: ugo+rw Sep 07 02:37:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:55 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c Sep 07 02:37:55 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:55 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c" returned: 0 in 0.239s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:55 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:55 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.info Sep 07 02:37:55 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:56 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.info" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:56 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.info is being set with open permissions: ugo+rw Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:56 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.info Sep 07 02:37:56 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:56 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.info" returned: 0 in 0.244s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:56 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-989883ca-df95-4355-8dc8-02e60cc59773 tempest-ProjectMemberTests-294561659 None] Create snapshot completed successfully Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-40326051-dff2-49f7-9bf6-6071e6c6958c-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Lock "cinder-40326051-dff2-49f7-9bf6-6071e6c6958c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-fb4a1bad-fd95-4b51-a52a-8d889e02167e" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-fb4a1bad-fd95-4b51-a52a-8d889e02167e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-40326051-dff2-49f7-9bf6-6071e6c6958c" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-40326051-dff2-49f7-9bf6-6071e6c6958c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Deleting offline snapshot 40326051-dff2-49f7-9bf6-6071e6c6958c of volume fb4a1bad-fd95-4b51-a52a-8d889e02167e {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] snapshot_file for this snap is: volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ea0a5f-330a-456a-9461-08efbfa565fe]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:56 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:56 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c Sep 07 02:37:56 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:57 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c" returned: 0 in 0.356s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:57 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:37:57 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93a25b9-047c-41f5-b2cb-48cac72c1e15]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:57 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e Sep 07 02:37:57 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:57 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e" returned: 0 in 0.349s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:57 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c Sep 07 02:37:57 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:57 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c" returned: 0 in 0.333s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:57 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:57 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c Sep 07 02:37:57 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:58 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e.40326051-dff2-49f7-9bf6-6071e6c6958c" returned: 0 in 0.239s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-40326051-dff2-49f7-9bf6-6071e6c6958c" released by "_delete_snapshot" :: held 1.359s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-fb4a1bad-fd95-4b51-a52a-8d889e02167e" released by "delete_snapshot" :: held 1.380s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:58 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Created reservations ['3d5dbe4e-a702-495b-b7a8-6168f316a372', '61c76800-e76b-4404-b690-77181cb248cb', '5a0ceb14-030d-4ff9-9e4a-16beeb8df6e5', '06fb492e-fe89-46e8-9a2b-8483ebf1c529'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:58 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Delete snapshot completed successfully. Sep 07 02:37:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-83d5eb63-dc9c-4e54-9f3f-a817f7c2e5f5 tempest-ProjectMemberTests-294561659 None] Lock "cinder-40326051-dff2-49f7-9bf6-6071e6c6958c-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-fb4a1bad-fd95-4b51-a52a-8d889e02167e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Lock "cinder-fb4a1bad-fd95-4b51-a52a-8d889e02167e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-fb4a1bad-fd95-4b51-a52a-8d889e02167e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:37:58 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-fb4a1bad-fd95-4b51-a52a-8d889e02167e" acquired by "delete_volume" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:37:58 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79d59b8-a34c-489b-a3e4-f8c4c311101c]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:37:58 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:58 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e Sep 07 02:37:58 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:59 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e" returned: 0 in 0.349s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:59 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e Sep 07 02:37:59 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:59 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-fb4a1bad-fd95-4b51-a52a-8d889e02167e" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-fb4a1bad-fd95-4b51-a52a-8d889e02167e" released by "delete_volume" :: held 0.642s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Created reservations ['c8c1f031-33b0-443e-8a64-ca58f4ba976b', '68421476-1976-4e5c-9f89-8e29a0b12ef1', 'f733a59a-9b90-49d4-93c9-7a344da653ed', '36958699-1a83-48c6-8892-2a39d4fac3d4'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:37:59 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:37:59 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:37:59 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.248s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:37:59 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Deleted volume successfully. Sep 07 02:37:59 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3e1f131-20e7-49ef-ac69-d7c6e22db062 tempest-ProjectMemberTests-294561659 None] Lock "cinder-fb4a1bad-fd95-4b51-a52a-8d889e02167e-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (0f3ab722-c73f-46f9-ab8c-16a80c06387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb48f55d-b363-4d58-97b9-dc7d9523d140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb48f55d-b363-4d58-97b9-dc7d9523d140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-968467892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a328c9-5756-4bfc-9f35-2996d482a725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:00Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce9f798-f811-4eb3-a14d-10b541dd8d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce9f798-f811-4eb3-a14d-10b541dd8d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16307f6a-0274-4dd3-869f-3f90ba99ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16307f6a-0274-4dd3-869f-3f90ba99ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a328c9-5756-4bfc-9f35-2996d482a725', 'volume_name': 'volume-95a328c9-5756-4bfc-9f35-2996d482a725', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abf3127-7b64-44cb-83f1-fe952b26d203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abf3127-7b64-44cb-83f1-fe952b26d203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0541eab5-5e4b-4cde-b224-b65357aaa862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:00 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Volume 95a328c9-5756-4bfc-9f35-2996d482a725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a328c9-5756-4bfc-9f35-2996d482a725', 'volume_size': 1} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-968467892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a328c9-5756-4bfc-9f35-2996d482a725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:00Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Creating volume 95a328c9-5756-4bfc-9f35-2996d482a725 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:38:00 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:00 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 1073741824 Sep 07 02:38:00 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:00 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 1073741824" returned: 0 in 0.394s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:00 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:00 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 Sep 07 02:38:00 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:01 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:INSERT=50,cinder:UPDATE=193,cinder:SELECT=155,cinder:DELETE=17 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0541eab5-5e4b-4cde-b224-b65357aaa862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a328c9-5756-4bfc-9f35-2996d482a725', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd4d591-2d82-4c29-a127-e78130d3eca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:01 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Volume volume-95a328c9-5756-4bfc-9f35-2996d482a725 (95a328c9-5756-4bfc-9f35-2996d482a725): created successfully Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd4d591-2d82-4c29-a127-e78130d3eca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (0f3ab722-c73f-46f9-ab8c-16a80c06387e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:01 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-39c9faab-2be2-499b-8522-b64767d63fdb tempest-ProjectMemberTests-294561659 None] Created volume successfully. Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] Creating offline snapshot 009a62b1-51e5-4f5b-aaf1-3451f437f0b7 of volume 95a328c9-5756-4bfc-9f35-2996d482a725 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55ecf82-ca06-40cf-be3c-5ba824304b7b]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:01 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 Sep 07 02:38:01 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:01 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725" returned: 0 in 0.353s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:01 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:01 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 1G Sep 07 02:38:01 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:02 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 1G" returned: 0 in 0.394s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95a328c9-5756-4bfc-9f35-2996d482a725 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:02 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95a328c9-5756-4bfc-9f35-2996d482a725 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 Sep 07 02:38:02 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:02 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95a328c9-5756-4bfc-9f35-2996d482a725 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7" returned: 0 in 0.292s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:02 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 is being set with open permissions: ugo+rw Sep 07 02:38:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:02 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 Sep 07 02:38:02 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:02 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7" returned: 0 in 0.255s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:02 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:02 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.info Sep 07 02:38:02 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:03 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.info" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:03 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.info is being set with open permissions: ugo+rw Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:03 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.info Sep 07 02:38:03 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:03 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.info" returned: 0 in 0.240s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:03 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-2639a1a0-f2e0-4363-ad9e-6a7d34ec0be3 tempest-ProjectMemberTests-294561659 None] Create snapshot completed successfully Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-009a62b1-51e5-4f5b-aaf1-3451f437f0b7-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Lock "cinder-009a62b1-51e5-4f5b-aaf1-3451f437f0b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-95a328c9-5756-4bfc-9f35-2996d482a725" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-95a328c9-5756-4bfc-9f35-2996d482a725" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-009a62b1-51e5-4f5b-aaf1-3451f437f0b7" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-009a62b1-51e5-4f5b-aaf1-3451f437f0b7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Deleting offline snapshot 009a62b1-51e5-4f5b-aaf1-3451f437f0b7 of volume 95a328c9-5756-4bfc-9f35-2996d482a725 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] snapshot_file for this snap is: volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a5a9b4-df1b-4827-9bda-808467d94ec7]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:03 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:03 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 Sep 07 02:38:03 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:04 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7" returned: 0 in 0.354s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:04 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95a328c9-5756-4bfc-9f35-2996d482a725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:38:04 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4758462-d0b5-4cec-ad0f-6ada0d2397d3]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:04 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 Sep 07 02:38:04 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:04 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725" returned: 0 in 0.353s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:04 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 Sep 07 02:38:04 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:04 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7" returned: 0 in 0.326s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:04 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:04 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7 Sep 07 02:38:04 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:05 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725.009a62b1-51e5-4f5b-aaf1-3451f437f0b7" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-009a62b1-51e5-4f5b-aaf1-3451f437f0b7" released by "_delete_snapshot" :: held 1.356s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-95a328c9-5756-4bfc-9f35-2996d482a725" released by "delete_snapshot" :: held 1.380s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:05 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Created reservations ['f0191e3e-34ea-4559-b1d1-949c1c1cb386', 'ab901d0f-fbdb-4de0-859e-b41b38aae44c', 'da6b32a6-e2b9-4b82-b9b0-2e584ecd43ed', '666c95bb-613e-41a5-9e5a-fc86c8f79f4e'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:05 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Delete snapshot completed successfully. Sep 07 02:38:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-a3288be8-2479-4e29-af73-7aef92c6a0dc tempest-ProjectMemberTests-294561659 None] Lock "cinder-009a62b1-51e5-4f5b-aaf1-3451f437f0b7-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-95a328c9-5756-4bfc-9f35-2996d482a725-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Lock "cinder-95a328c9-5756-4bfc-9f35-2996d482a725-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-95a328c9-5756-4bfc-9f35-2996d482a725" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:05 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-95a328c9-5756-4bfc-9f35-2996d482a725" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:05 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f079bd7-e404-4d02-8ef7-e00d7beb858e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:05 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:05 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 Sep 07 02:38:05 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:06 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725" returned: 0 in 0.339s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:06 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725 Sep 07 02:38:06 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:06 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-95a328c9-5756-4bfc-9f35-2996d482a725" returned: 0 in 0.235s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-95a328c9-5756-4bfc-9f35-2996d482a725" released by "delete_volume" :: held 0.626s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Created reservations ['699a4bca-117d-487a-8e6a-578422acc062', 'dd22bd3a-8894-4739-b909-0d4defd6c11a', '996f0322-9f52-4184-b0e8-50d1d64f758d', 'c9311a63-901e-486c-898c-551258e58b1b'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:06 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:38:06 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:06 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.235s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:38:06 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Deleted volume successfully. Sep 07 02:38:06 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-21cd6c72-4173-4698-b306-c8a9fda92d95 tempest-ProjectMemberTests-294561659 None] Lock "cinder-95a328c9-5756-4bfc-9f35-2996d482a725-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (8d284ce4-a8a0-42f2-9443-76bda5f29c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17b815b-537f-415e-b45f-627451de27b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17b815b-537f-415e-b45f-627451de27b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496036780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be50bfd-2905-42ff-8079-1c3cde12ec15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:07Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a4e358-933d-4ead-ab76-1808414476a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a4e358-933d-4ead-ab76-1808414476a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470684e8-7c6b-4911-91b1-99504cbea931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470684e8-7c6b-4911-91b1-99504cbea931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be50bfd-2905-42ff-8079-1c3cde12ec15', 'volume_name': 'volume-9be50bfd-2905-42ff-8079-1c3cde12ec15', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891aed69-b64b-49f7-9ca5-8d6931cba96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891aed69-b64b-49f7-9ca5-8d6931cba96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d6d93f-62b6-43c8-8b3c-2c8537311fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:07 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Volume 9be50bfd-2905-42ff-8079-1c3cde12ec15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be50bfd-2905-42ff-8079-1c3cde12ec15', 'volume_size': 1} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496036780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be50bfd-2905-42ff-8079-1c3cde12ec15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e942b2909c42ba8cabf161e91854ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:07Z,use_quota=True,user_id='fe95f819d8254358a1fab89c4a3a6b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Creating volume 9be50bfd-2905-42ff-8079-1c3cde12ec15 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:38:07 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:07 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 1073741824 Sep 07 02:38:07 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:07 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 1073741824" returned: 0 in 0.390s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:07 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:07 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 Sep 07 02:38:07 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:08 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15" returned: 0 in 0.240s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d6d93f-62b6-43c8-8b3c-2c8537311fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be50bfd-2905-42ff-8079-1c3cde12ec15', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09599319-8c18-46be-85e2-c54f846c22ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:08 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Volume volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 (9be50bfd-2905-42ff-8079-1c3cde12ec15): created successfully Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09599319-8c18-46be-85e2-c54f846c22ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Flow 'volume_create_manager' (8d284ce4-a8a0-42f2-9443-76bda5f29c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:08 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-86d25f1f-8300-4571-afc4-4a7889bd5204 tempest-ProjectMemberTests-294561659 None] Created volume successfully. Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] Creating offline snapshot 28d00420-e695-4e59-a351-32abebfb43b2 of volume 9be50bfd-2905-42ff-8079-1c3cde12ec15 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[433b5e4b-3aca-4ede-8bf9-11a3e93c467e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:08 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 Sep 07 02:38:08 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:08 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15" returned: 0 in 0.343s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:08 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:08 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 1G Sep 07 02:38:08 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:09 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 1G" returned: 0 in 0.372s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:09 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 Sep 07 02:38:09 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:09 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2" returned: 0 in 0.281s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:09 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 is being set with open permissions: ugo+rw Sep 07 02:38:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:09 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 Sep 07 02:38:09 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:09 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2" returned: 0 in 0.229s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:09 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:09 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.info Sep 07 02:38:09 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:10 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.info" returned: 0 in 0.248s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:10 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.info is being set with open permissions: ugo+rw Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:10 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.info Sep 07 02:38:10 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:10 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.info" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.794s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:10 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-b3ddd129-4378-4d02-88b6-ec6b0ac5f414 tempest-ProjectMemberTests-294561659 None] Create snapshot completed successfully Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-28d00420-e695-4e59-a351-32abebfb43b2-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Lock "cinder-28d00420-e695-4e59-a351-32abebfb43b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-9be50bfd-2905-42ff-8079-1c3cde12ec15" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-9be50bfd-2905-42ff-8079-1c3cde12ec15" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-28d00420-e695-4e59-a351-32abebfb43b2" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-28d00420-e695-4e59-a351-32abebfb43b2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Deleting offline snapshot 28d00420-e695-4e59-a351-32abebfb43b2 of volume 9be50bfd-2905-42ff-8079-1c3cde12ec15 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] snapshot_file for this snap is: volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a50257b-fc3d-4883-9385-1ca24513af93]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:10 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:10 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 Sep 07 02:38:10 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:11 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2" returned: 0 in 0.356s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:11 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9be50bfd-2905-42ff-8079-1c3cde12ec15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:38:11 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59ddae2-91d9-4f8e-8837-307a8ef6c3f7]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:11 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 Sep 07 02:38:11 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:11 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15" returned: 0 in 0.352s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:11 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 Sep 07 02:38:11 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:11 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2" returned: 0 in 0.333s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:11 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:11 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2 Sep 07 02:38:11 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:12 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:12 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15.28d00420-e695-4e59-a351-32abebfb43b2" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-28d00420-e695-4e59-a351-32abebfb43b2" released by "_delete_snapshot" :: held 1.365s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-9be50bfd-2905-42ff-8079-1c3cde12ec15" released by "delete_snapshot" :: held 1.387s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:12 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Created reservations ['6a862e2e-583e-4c2c-9374-d5ad13c9632d', '0d2d34c3-f547-4518-98a9-d519eab1b88f', '053ecfea-ccb1-4f98-8674-0f67550424b8', '610e919a-a55b-44af-bce1-76ecb001ddd3'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:12 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Delete snapshot completed successfully. Sep 07 02:38:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-deac90b3-38f6-4828-8ce4-fd7f3ba43ed3 tempest-ProjectMemberTests-294561659 None] Lock "cinder-28d00420-e695-4e59-a351-32abebfb43b2-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-9be50bfd-2905-42ff-8079-1c3cde12ec15-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Lock "cinder-9be50bfd-2905-42ff-8079-1c3cde12ec15-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Acquiring lock "cinder-quobyte-9be50bfd-2905-42ff-8079-1c3cde12ec15" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:12 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-9be50bfd-2905-42ff-8079-1c3cde12ec15" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[4213a58b-26fa-4fb5-ab91-8f28651c4269]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:13 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 Sep 07 02:38:13 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:13 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15" returned: 0 in 0.348s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:13 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15 Sep 07 02:38:13 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:13 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-9be50bfd-2905-42ff-8079-1c3cde12ec15" returned: 0 in 0.236s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Lock "cinder-quobyte-9be50bfd-2905-42ff-8079-1c3cde12ec15" released by "delete_volume" :: held 0.637s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Created reservations ['b51a71d6-1e21-47b8-b89c-499f8430d6e7', '4c95ad65-51b1-4a8d-ac26-1aa5b4943aa7', '1fe6f07a-3f88-4465-9166-a7dec2f09ead', '7f5d19d5-d704-4be1-8cff-076cf7ba81a9'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:13 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:38:13 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:13 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.235s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:38:13 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Deleted volume successfully. Sep 07 02:38:13 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-c317ed80-02ea-430d-ad90-4062706cbcc8 tempest-ProjectMemberTests-294561659 None] Lock "cinder-9be50bfd-2905-42ff-8079-1c3cde12ec15-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Flow 'volume_create_manager' (9e9df465-41c9-463e-8414-2c2d4ecf2667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fb961c-1b31-4303-a461-a3d3f02769ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fb961c-1b31-4303-a461-a3d3f02769ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-90788857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cea9693-cbf0-4b63-946f-485ec329374e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c539dd6b2747d5a2b67d8791d74a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:17Z,use_quota=True,user_id='e776d90d8ab848c59b2d131720ca0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0583d5f-804d-4137-9e69-74248fef5ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0583d5f-804d-4137-9e69-74248fef5ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2964e8-15ac-4825-aed7-ac2d0b3cbfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2964e8-15ac-4825-aed7-ac2d0b3cbfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cea9693-cbf0-4b63-946f-485ec329374e', 'volume_name': 'volume-5cea9693-cbf0-4b63-946f-485ec329374e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f50162-e09a-4698-8623-648de608bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f50162-e09a-4698-8623-648de608bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38178c5b-16b3-43d5-b8c6-c3a1c241648a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:17 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Volume 5cea9693-cbf0-4b63-946f-485ec329374e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cea9693-cbf0-4b63-946f-485ec329374e', 'volume_size': 1} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-90788857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cea9693-cbf0-4b63-946f-485ec329374e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c539dd6b2747d5a2b67d8791d74a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:17Z,use_quota=True,user_id='e776d90d8ab848c59b2d131720ca0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Creating volume 5cea9693-cbf0-4b63-946f-485ec329374e {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:38:17 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:17 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e 1073741824 Sep 07 02:38:17 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:17 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e 1073741824" returned: 0 in 0.383s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:17 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:18 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e Sep 07 02:38:18 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:18 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e" returned: 0 in 0.255s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38178c5b-16b3-43d5-b8c6-c3a1c241648a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cea9693-cbf0-4b63-946f-485ec329374e', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420901aa-1e8e-42be-9776-55ed7c661ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:18 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Volume volume-5cea9693-cbf0-4b63-946f-485ec329374e (5cea9693-cbf0-4b63-946f-485ec329374e): created successfully Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420901aa-1e8e-42be-9776-55ed7c661ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Flow 'volume_create_manager' (9e9df465-41c9-463e-8414-2c2d4ecf2667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:18 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-bcfc81e2-10b7-424d-aadf-94a0b51948d5 tempest-ProjectReaderTests-1553224857 None] Created volume successfully. Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] Creating offline snapshot f9faecfb-981b-455a-b3cc-248b7ce76b4e of volume 5cea9693-cbf0-4b63-946f-485ec329374e {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[59168870-d5c3-42ea-90fe-aed91e1711fe]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:18 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:18 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e Sep 07 02:38:18 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:19 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e" returned: 0 in 0.366s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:19 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e 1G Sep 07 02:38:19 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:19 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e 1G" returned: 0 in 0.393s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cea9693-cbf0-4b63-946f-485ec329374e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:19 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cea9693-cbf0-4b63-946f-485ec329374e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e Sep 07 02:38:19 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:19 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cea9693-cbf0-4b63-946f-485ec329374e -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e" returned: 0 in 0.289s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:19 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e is being set with open permissions: ugo+rw Sep 07 02:38:19 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:19 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e Sep 07 02:38:19 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:20 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e" returned: 0 in 0.250s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:20 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.info Sep 07 02:38:20 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:20 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.info" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:20 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.info is being set with open permissions: ugo+rw Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:20 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.info Sep 07 02:38:20 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:20 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.info" returned: 0 in 0.251s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:20 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-0b6c4605-5388-4713-bc7d-b725d2bc17b9 tempest-ProjectReaderTests-1553224857 None] Create snapshot completed successfully Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-f9faecfb-981b-455a-b3cc-248b7ce76b4e-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-f9faecfb-981b-455a-b3cc-248b7ce76b4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-5cea9693-cbf0-4b63-946f-485ec329374e" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-5cea9693-cbf0-4b63-946f-485ec329374e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-f9faecfb-981b-455a-b3cc-248b7ce76b4e" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-f9faecfb-981b-455a-b3cc-248b7ce76b4e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Deleting offline snapshot f9faecfb-981b-455a-b3cc-248b7ce76b4e of volume 5cea9693-cbf0-4b63-946f-485ec329374e {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] snapshot_file for this snap is: volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d5bbe2-b51c-437c-9828-82d00aa18762]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:20 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:21 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e Sep 07 02:38:21 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:21 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e" returned: 0 in 0.359s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:21 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cea9693-cbf0-4b63-946f-485ec329374e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:38:21 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc533cd-c2dc-4257-9fac-2f1d49f85c77]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:21 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e Sep 07 02:38:21 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:21 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e" returned: 0 in 0.357s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:21 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:21 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e Sep 07 02:38:21 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:22 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e" returned: 0 in 0.331s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:22 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e Sep 07 02:38:22 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:22 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:22 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e.f9faecfb-981b-455a-b3cc-248b7ce76b4e" returned: 0 in 0.251s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-f9faecfb-981b-455a-b3cc-248b7ce76b4e" released by "_delete_snapshot" :: held 1.380s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-5cea9693-cbf0-4b63-946f-485ec329374e" released by "delete_snapshot" :: held 1.403s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:22 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Created reservations ['5a708707-3d64-45d7-b1e9-9bdf5b17b6e5', '642e2e53-1f98-415c-b80a-9a6d61c151f7', '0dbbc560-4528-433c-9c43-ebd14bd98f9c', 'd5cc9514-c00a-4d07-afdd-0f611541a62d'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:22 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Delete snapshot completed successfully. Sep 07 02:38:22 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1bc28be8-41ad-4f76-a710-96c78196b30a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-f9faecfb-981b-455a-b3cc-248b7ce76b4e-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-5cea9693-cbf0-4b63-946f-485ec329374e-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-5cea9693-cbf0-4b63-946f-485ec329374e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-5cea9693-cbf0-4b63-946f-485ec329374e" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-5cea9693-cbf0-4b63-946f-485ec329374e" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f89cf79-9b0f-4673-affe-1f9aa1f3ad80]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:23 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e Sep 07 02:38:23 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:23 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e" returned: 0 in 0.352s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:23 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e Sep 07 02:38:23 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:23 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-5cea9693-cbf0-4b63-946f-485ec329374e" returned: 0 in 0.239s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-5cea9693-cbf0-4b63-946f-485ec329374e" released by "delete_volume" :: held 0.646s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Created reservations ['e6494e85-3436-400b-8e97-c85789bafa4a', 'f5c6983a-52b2-486a-b3e0-00d78ed5cc50', '6943d674-a693-4350-a029-c5d990cb45bc', '5674ee49-053a-4f71-bebb-da19efdd0f29'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:23 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:23 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:38:23 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:24 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:38:24 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Deleted volume successfully. Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-65b18483-eb84-4073-a316-fe8866f13381 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-5cea9693-cbf0-4b63-946f-485ec329374e-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Flow 'volume_create_manager' (7b89d23d-9314-434b-9ea1-e65f4de549b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8ec1da-69f3-4148-bc8e-2e01d8b3d85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8ec1da-69f3-4148-bc8e-2e01d8b3d85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289946894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc7f22a-052b-4e34-b7f6-edb0beecb781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c539dd6b2747d5a2b67d8791d74a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:25Z,use_quota=True,user_id='e776d90d8ab848c59b2d131720ca0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4f1b94-cb67-4b0b-83ed-14500464917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4f1b94-cb67-4b0b-83ed-14500464917b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d5bb46-161f-442a-b07a-4a0e230b6082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d5bb46-161f-442a-b07a-4a0e230b6082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfc7f22a-052b-4e34-b7f6-edb0beecb781', 'volume_name': 'volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df8f1a7-4c28-4d91-a0fb-fa3d3743c523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df8f1a7-4c28-4d91-a0fb-fa3d3743c523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d00abb-1bb6-41e3-84f2-18b4e97d6898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:24 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Volume bfc7f22a-052b-4e34-b7f6-edb0beecb781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781', 'volume_size': 1} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289946894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc7f22a-052b-4e34-b7f6-edb0beecb781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c539dd6b2747d5a2b67d8791d74a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:25Z,use_quota=True,user_id='e776d90d8ab848c59b2d131720ca0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Creating volume bfc7f22a-052b-4e34-b7f6-edb0beecb781 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:38:24 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:38:24 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:24 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 1073741824 Sep 07 02:38:24 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:25 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 1073741824" returned: 0 in 0.420s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:25 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 Sep 07 02:38:25 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:25 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781" returned: 0 in 0.255s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d00abb-1bb6-41e3-84f2-18b4e97d6898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef2ca3e-e85f-44d0-928e-160cb04efa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:25 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Volume volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 (bfc7f22a-052b-4e34-b7f6-edb0beecb781): created successfully Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef2ca3e-e85f-44d0-928e-160cb04efa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Flow 'volume_create_manager' (7b89d23d-9314-434b-9ea1-e65f4de549b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:25 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-77425671-b14d-499e-bf79-ab7c1ee871e2 tempest-ProjectReaderTests-1553224857 None] Created volume successfully. Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] Creating offline snapshot 0d81a493-f374-4a83-950c-5e5c32572bad of volume bfc7f22a-052b-4e34-b7f6-edb0beecb781 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69115e7-6e4d-4409-965e-34c7cd190edf]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:25 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:25 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 Sep 07 02:38:25 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:26 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781" returned: 0 in 0.357s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:26 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad 1G Sep 07 02:38:26 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:26 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:38:26 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:26 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_service.periodic_task [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] Running periodic task VolumeManager._thread_info {{(pid=87313) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread count: 28 {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-b08cef79-78d9-4943-bba1-22f3381b4563 None None] thread info: [<_MainThread(MainThread, started 124785543360640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87313) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 02:38:26 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad 1G" returned: 0 in 0.402s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:26 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad Sep 07 02:38:26 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:26 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad" returned: 0 in 0.289s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:26 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad is being set with open permissions: ugo+rw Sep 07 02:38:26 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:26 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad Sep 07 02:38:26 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:27 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad" returned: 0 in 0.251s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:27 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.info Sep 07 02:38:27 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:27 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.info" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:27 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.info is being set with open permissions: ugo+rw Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:27 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.info Sep 07 02:38:27 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:27 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.info" returned: 0 in 0.250s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:27 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-822736d8-bda3-489c-a58e-10db9f9df20b tempest-ProjectReaderTests-1553224857 None] Create snapshot completed successfully Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-0d81a493-f374-4a83-950c-5e5c32572bad-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-0d81a493-f374-4a83-950c-5e5c32572bad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-bfc7f22a-052b-4e34-b7f6-edb0beecb781" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-bfc7f22a-052b-4e34-b7f6-edb0beecb781" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-0d81a493-f374-4a83-950c-5e5c32572bad" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-0d81a493-f374-4a83-950c-5e5c32572bad" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:27 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Deleting offline snapshot 0d81a493-f374-4a83-950c-5e5c32572bad of volume bfc7f22a-052b-4e34-b7f6-edb0beecb781 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:38:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] snapshot_file for this snap is: volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:38:28 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cc1eea-7a49-467c-8f3d-37490a9cfa14]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:28 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad Sep 07 02:38:28 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:28 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad" returned: 0 in 0.366s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:28 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:38:28 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[574ede89-38a9-4bf3-b229-46ccd8f7e093]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:28 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 Sep 07 02:38:28 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:28 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781" returned: 0 in 0.360s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:28 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:28 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad Sep 07 02:38:28 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:29 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad" returned: 0 in 0.331s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:29 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad Sep 07 02:38:29 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:29 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:29 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781.0d81a493-f374-4a83-950c-5e5c32572bad" returned: 0 in 0.256s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:29 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-0d81a493-f374-4a83-950c-5e5c32572bad" released by "_delete_snapshot" :: held 1.402s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:29 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-bfc7f22a-052b-4e34-b7f6-edb0beecb781" released by "delete_snapshot" :: held 1.426s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:29 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Created reservations ['b731501f-3f59-4a1d-be82-01cda9ec01ff', 'c826111c-e447-431e-a11d-8737721ffed3', '7c7b036c-5f28-4a26-bdce-fef09535d4f9', 'c85d8c5c-a079-4885-a6de-00d94afb98d2'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:29 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Delete snapshot completed successfully. Sep 07 02:38:29 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-6df4fb51-bd59-46b8-95d4-bb5bed088c2d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-0d81a493-f374-4a83-950c-5e5c32572bad-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-bfc7f22a-052b-4e34-b7f6-edb0beecb781-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-bfc7f22a-052b-4e34-b7f6-edb0beecb781-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-bfc7f22a-052b-4e34-b7f6-edb0beecb781" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-bfc7f22a-052b-4e34-b7f6-edb0beecb781" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb3467e-f215-4fef-961d-2ad533a43d67]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:30 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 Sep 07 02:38:30 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:30 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781" returned: 0 in 0.383s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:30 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781 Sep 07 02:38:30 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:30 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-bfc7f22a-052b-4e34-b7f6-edb0beecb781" returned: 0 in 0.253s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-bfc7f22a-052b-4e34-b7f6-edb0beecb781" released by "delete_volume" :: held 0.693s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Created reservations ['07a326ea-cc2d-414c-9d4b-4bd97579e9c3', 'ffb31f55-9f67-4ee5-b878-3a3b64963e25', '4bc5c627-c43b-4c89-99d2-b2e32e72ef0a', 'ab30fe0e-79d5-478e-b79c-6c69cd7a45a9'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:30 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:31 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:38:31 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:31 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.274s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:38:31 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Deleted volume successfully. Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7c8c6e2a-be77-471f-8b3f-4715ae309bf9 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-bfc7f22a-052b-4e34-b7f6-edb0beecb781-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Flow 'volume_create_manager' (7b28fa74-36c4-4b20-89e5-9a2cca84b500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b64e1a9-56ad-45f2-9308-6f8580b8ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b64e1a9-56ad-45f2-9308-6f8580b8ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320641660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ee5fec-08a3-4987-a4a3-7af8005f072a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c539dd6b2747d5a2b67d8791d74a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:32Z,use_quota=True,user_id='e776d90d8ab848c59b2d131720ca0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c11b37-d7cf-429a-8da5-418ca2345479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c11b37-d7cf-429a-8da5-418ca2345479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae5b95f-7b98-4c27-929e-09d55ca7d98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae5b95f-7b98-4c27-929e-09d55ca7d98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ee5fec-08a3-4987-a4a3-7af8005f072a', 'volume_name': 'volume-63ee5fec-08a3-4987-a4a3-7af8005f072a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a73b64-fb2d-4129-b095-6df4778e6afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a73b64-fb2d-4129-b095-6df4778e6afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18bcc25-64c5-4140-ba3f-531f83ecdd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:31 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Volume 63ee5fec-08a3-4987-a4a3-7af8005f072a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ee5fec-08a3-4987-a4a3-7af8005f072a', 'volume_size': 1} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320641660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ee5fec-08a3-4987-a4a3-7af8005f072a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c539dd6b2747d5a2b67d8791d74a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:32Z,use_quota=True,user_id='e776d90d8ab848c59b2d131720ca0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Creating volume 63ee5fec-08a3-4987-a4a3-7af8005f072a {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:38:31 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:38:31 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:31 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a 1073741824 Sep 07 02:38:31 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:32 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a 1073741824" returned: 0 in 0.409s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:32 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a Sep 07 02:38:32 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:32 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18bcc25-64c5-4140-ba3f-531f83ecdd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ee5fec-08a3-4987-a4a3-7af8005f072a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e51bcdb-a90f-4780-bbbb-a0fcf756a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:32 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Volume volume-63ee5fec-08a3-4987-a4a3-7af8005f072a (63ee5fec-08a3-4987-a4a3-7af8005f072a): created successfully Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e51bcdb-a90f-4780-bbbb-a0fcf756a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Flow 'volume_create_manager' (7b28fa74-36c4-4b20-89e5-9a2cca84b500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:32 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-37e2af87-cc85-4d2e-be06-fc7bcf97e36b tempest-ProjectReaderTests-1553224857 None] Created volume successfully. Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] Creating offline snapshot 3ba56dce-feb3-45c3-a8f1-430540b920cf of volume 63ee5fec-08a3-4987-a4a3-7af8005f072a {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[f405d60e-0d89-40cb-8322-fd3d6bb85af2]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:32 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:33 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a Sep 07 02:38:33 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:33 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a" returned: 0 in 0.368s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:33 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf 1G Sep 07 02:38:33 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:33 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf 1G" returned: 0 in 0.375s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ee5fec-08a3-4987-a4a3-7af8005f072a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:33 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ee5fec-08a3-4987-a4a3-7af8005f072a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf Sep 07 02:38:33 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:33 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ee5fec-08a3-4987-a4a3-7af8005f072a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf" returned: 0 in 0.292s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:33 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf is being set with open permissions: ugo+rw Sep 07 02:38:33 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:34 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf Sep 07 02:38:34 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:34 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf" returned: 0 in 0.250s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:34 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.info Sep 07 02:38:34 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:34 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.info" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:34 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.info is being set with open permissions: ugo+rw Sep 07 02:38:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:34 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.info Sep 07 02:38:34 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:34 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.info" returned: 0 in 0.249s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:34 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:34 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-09f60061-81b9-47f6-b387-5a13df5a52cd tempest-ProjectReaderTests-1553224857 None] Create snapshot completed successfully Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-3ba56dce-feb3-45c3-a8f1-430540b920cf-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-3ba56dce-feb3-45c3-a8f1-430540b920cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-63ee5fec-08a3-4987-a4a3-7af8005f072a" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-63ee5fec-08a3-4987-a4a3-7af8005f072a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-3ba56dce-feb3-45c3-a8f1-430540b920cf" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-3ba56dce-feb3-45c3-a8f1-430540b920cf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Deleting offline snapshot 3ba56dce-feb3-45c3-a8f1-430540b920cf of volume 63ee5fec-08a3-4987-a4a3-7af8005f072a {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] snapshot_file for this snap is: volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef82bef2-5425-4609-894d-2ebaa743944e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:35 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf Sep 07 02:38:35 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:35 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf" returned: 0 in 0.354s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63ee5fec-08a3-4987-a4a3-7af8005f072a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae37c05b-ea8f-4a29-b952-dc8b79935c1e]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:35 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a Sep 07 02:38:35 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:35 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a" returned: 0 in 0.351s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:35 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:35 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf Sep 07 02:38:35 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:36 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf" returned: 0 in 0.329s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:36 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf Sep 07 02:38:36 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:36 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:36 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a.3ba56dce-feb3-45c3-a8f1-430540b920cf" returned: 0 in 0.236s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-3ba56dce-feb3-45c3-a8f1-430540b920cf" released by "_delete_snapshot" :: held 1.355s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-63ee5fec-08a3-4987-a4a3-7af8005f072a" released by "delete_snapshot" :: held 1.376s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:36 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Created reservations ['d9ae6778-feda-4d93-9c7d-d0740e33b8a5', 'f4efb003-e1b0-4f4d-bddb-ad026eabf221', '2ff949c7-975f-4349-81b0-2997df97846d', '290c7ea1-0a41-4a85-bead-d0b83f9cc274'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:36 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Delete snapshot completed successfully. Sep 07 02:38:36 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-3b32fbb7-6e87-4ea4-adfc-f55b6b47930d tempest-ProjectReaderTests-1553224857 None] Lock "cinder-3ba56dce-feb3-45c3-a8f1-430540b920cf-delete_snapshot" released by "delete_snapshot" :: held 1.514s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-63ee5fec-08a3-4987-a4a3-7af8005f072a-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-63ee5fec-08a3-4987-a4a3-7af8005f072a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-63ee5fec-08a3-4987-a4a3-7af8005f072a" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-63ee5fec-08a3-4987-a4a3-7af8005f072a" acquired by "delete_volume" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:37 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[2873daed-2798-4b97-99bb-21d6c260d594]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:37 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a Sep 07 02:38:37 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:37 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a" returned: 0 in 0.357s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:37 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a Sep 07 02:38:37 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:37 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:37 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-63ee5fec-08a3-4987-a4a3-7af8005f072a" returned: 0 in 0.247s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:37 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-63ee5fec-08a3-4987-a4a3-7af8005f072a" released by "delete_volume" :: held 0.660s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:37 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Created reservations ['08e04072-cf1f-4ac4-b0a3-655d7630fabe', 'cae224d6-d24d-456d-a954-843eb054fa3a', 'de652f9c-9857-466a-b126-82ac254d389a', '45f9a568-6a56-489e-9548-6a86d4c012e2'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:38 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:38:38 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:38 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.255s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:38:38 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Deleted volume successfully. Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-482cab93-9181-4726-b844-fd8ce4c92f27 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-63ee5fec-08a3-4987-a4a3-7af8005f072a-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Flow 'volume_create_manager' (4093601f-9030-4dee-aa59-681641a3f313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245a9aac-c6eb-4516-b5fd-f69b6a43d62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245a9aac-c6eb-4516-b5fd-f69b6a43d62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812726996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048a64d0-e714-472f-84df-4e1b096690c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c539dd6b2747d5a2b67d8791d74a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:39Z,use_quota=True,user_id='e776d90d8ab848c59b2d131720ca0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2cc48d-5c78-40f2-8720-9369c9704dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2cc48d-5c78-40f2-8720-9369c9704dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6b9d1d-31ec-42eb-9fa3-dd6607c5053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6b9d1d-31ec-42eb-9fa3-dd6607c5053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '048a64d0-e714-472f-84df-4e1b096690c2', 'volume_name': 'volume-048a64d0-e714-472f-84df-4e1b096690c2', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff1348c-a561-4f10-8218-9cfceb4890ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff1348c-a561-4f10-8218-9cfceb4890ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621f5b05-a4db-4a17-960a-90a7068d9c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:38 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Volume 048a64d0-e714-472f-84df-4e1b096690c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-048a64d0-e714-472f-84df-4e1b096690c2', 'volume_size': 1} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812726996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048a64d0-e714-472f-84df-4e1b096690c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c539dd6b2747d5a2b67d8791d74a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:39Z,use_quota=True,user_id='e776d90d8ab848c59b2d131720ca0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Creating volume 048a64d0-e714-472f-84df-4e1b096690c2 {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:38:38 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:38:38 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:38 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 1073741824 Sep 07 02:38:38 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:39 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 1073741824" returned: 0 in 0.396s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:39 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 Sep 07 02:38:39 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:39 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2" returned: 0 in 0.251s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621f5b05-a4db-4a17-960a-90a7068d9c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048a64d0-e714-472f-84df-4e1b096690c2', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4645b1c-0bad-483f-ac28-64253d8dd580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:39 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Volume volume-048a64d0-e714-472f-84df-4e1b096690c2 (048a64d0-e714-472f-84df-4e1b096690c2): created successfully Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4645b1c-0bad-483f-ac28-64253d8dd580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Flow 'volume_create_manager' (4093601f-9030-4dee-aa59-681641a3f313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:39 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-e1542815-71c9-49f2-bb9d-53764c46a4ca tempest-ProjectReaderTests-1553224857 None] Created volume successfully. Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] Creating offline snapshot 2b8628a6-03cf-4dc3-a595-be4eb4afd5fd of volume 048a64d0-e714-472f-84df-4e1b096690c2 {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca14a69c-d335-4e82-93ff-d75d7d6a044f]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:39 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:40 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 Sep 07 02:38:40 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:40 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2" returned: 0 in 0.354s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:40 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd 1G Sep 07 02:38:40 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:40 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd 1G" returned: 0 in 0.373s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048a64d0-e714-472f-84df-4e1b096690c2 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:40 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048a64d0-e714-472f-84df-4e1b096690c2 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd Sep 07 02:38:40 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:40 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048a64d0-e714-472f-84df-4e1b096690c2 -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd" returned: 0 in 0.281s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:40 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd is being set with open permissions: ugo+rw Sep 07 02:38:40 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:41 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd Sep 07 02:38:41 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:41 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd" returned: 0 in 0.245s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:41 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.info Sep 07 02:38:41 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:41 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.info" returned: 0 in 0.255s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:41 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.info is being set with open permissions: ugo+rw Sep 07 02:38:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:41 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.info Sep 07 02:38:41 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:41 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.info" returned: 0 in 0.238s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:41 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:41 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-4b266e8a-2ca1-4cc4-8852-c3174e3f0343 tempest-ProjectReaderTests-1553224857 None] Create snapshot completed successfully Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-2b8628a6-03cf-4dc3-a595-be4eb4afd5fd-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-2b8628a6-03cf-4dc3-a595-be4eb4afd5fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-048a64d0-e714-472f-84df-4e1b096690c2" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-048a64d0-e714-472f-84df-4e1b096690c2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-2b8628a6-03cf-4dc3-a595-be4eb4afd5fd" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-2b8628a6-03cf-4dc3-a595-be4eb4afd5fd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Deleting offline snapshot 2b8628a6-03cf-4dc3-a595-be4eb4afd5fd of volume 048a64d0-e714-472f-84df-4e1b096690c2 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] snapshot_file for this snap is: volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c205ee-2ef2-4694-9840-e82053f1cc22]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:42 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd Sep 07 02:38:42 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:42 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd" returned: 0 in 0.354s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-048a64d0-e714-472f-84df-4e1b096690c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bb2157-a20a-4acb-9f52-5bff319781e0]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:42 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 Sep 07 02:38:42 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:42 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2" returned: 0 in 0.342s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:42 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:42 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd Sep 07 02:38:42 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:43 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd" returned: 0 in 0.340s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:43 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd Sep 07 02:38:43 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:43 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:43 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2.2b8628a6-03cf-4dc3-a595-be4eb4afd5fd" returned: 0 in 0.249s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-2b8628a6-03cf-4dc3-a595-be4eb4afd5fd" released by "_delete_snapshot" :: held 1.366s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-048a64d0-e714-472f-84df-4e1b096690c2" released by "delete_snapshot" :: held 1.387s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:43 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Created reservations ['8812ba79-1f0b-4556-b312-1dab586bea3f', 'a20defd1-2c61-40bc-a25e-5bd1d6437a29', '80b1fbd0-59f3-4854-82fe-4e7d12724a29', 'a9f82119-4aa4-43a8-b778-bea816284afc'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:43 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Delete snapshot completed successfully. Sep 07 02:38:43 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-5436a16b-ef17-45e1-ac1d-869c90861240 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-2b8628a6-03cf-4dc3-a595-be4eb4afd5fd-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-048a64d0-e714-472f-84df-4e1b096690c2-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-048a64d0-e714-472f-84df-4e1b096690c2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-048a64d0-e714-472f-84df-4e1b096690c2" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-048a64d0-e714-472f-84df-4e1b096690c2" acquired by "delete_volume" :: waited 0.013s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:44 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[3887209f-c952-41c6-ba76-05a9828af8d4]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:44 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 Sep 07 02:38:44 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:44 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2" returned: 0 in 0.359s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:44 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2 Sep 07 02:38:44 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:44 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:44 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-048a64d0-e714-472f-84df-4e1b096690c2" returned: 0 in 0.242s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:44 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-048a64d0-e714-472f-84df-4e1b096690c2" released by "delete_volume" :: held 0.649s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:44 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Created reservations ['651dd29a-3b86-43d2-aafe-31c9e1d99e19', '468d826e-9619-40f2-bb09-20fe197e5831', '90552849-0f46-4854-bb6b-e450618c79ca', '9c07a114-e7f3-4e35-89b0-a29e905d77a3'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:45 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:38:45 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:45 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.237s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:38:45 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Deleted volume successfully. Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7cb19f44-aa32-4e01-b527-e4976344dd82 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-048a64d0-e714-472f-84df-4e1b096690c2-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=110,cinder:INSERT=45,cinder:UPDATE=154,cinder:DELETE=16 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.flows.manager.create_volume [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87313) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Flow 'volume_create_manager' (b3a5bc31-ccce-4b79-a0b4-aff9f387cf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55676bc1-f426-4dcb-acf1-483439b429b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55676bc1-f426-4dcb-acf1-483439b429b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1704293239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=778c1887-0f3e-40f6-8005-cd852781bf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c539dd6b2747d5a2b67d8791d74a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:46Z,use_quota=True,user_id='e776d90d8ab848c59b2d131720ca0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a3139b-0689-4fd8-b1dc-2445ece5db31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a3139b-0689-4fd8-b1dc-2445ece5db31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632a0c12-7cdb-4f27-975d-560f3e206e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632a0c12-7cdb-4f27-975d-560f3e206e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '778c1887-0f3e-40f6-8005-cd852781bf9a', 'volume_name': 'volume-778c1887-0f3e-40f6-8005-cd852781bf9a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cfd77c-a39c-4036-a5b4-22e9dba0a972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cfd77c-a39c-4036-a5b4-22e9dba0a972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1c2c91-8ae8-47e0-b2b0-ce865543a8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:45 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Volume 778c1887-0f3e-40f6-8005-cd852781bf9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-778c1887-0f3e-40f6-8005-cd852781bf9a', 'volume_size': 1} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T00:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1704293239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=778c1887-0f3e-40f6-8005-cd852781bf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c539dd6b2747d5a2b67d8791d74a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T00:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T00:38:46Z,use_quota=True,user_id='e776d90d8ab848c59b2d131720ca0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d5926e7-842c-4e8b-8edc-ba07a01b18d4),volume_type_id=7d5926e7-842c-4e8b-8edc-ba07a01b18d4)}" {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Creating volume 778c1887-0f3e-40f6-8005-cd852781bf9a {{(pid=87313) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Selected osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 as target Quobyte volume. {{(pid=87313) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 02:38:45 devstack cinder-volume[87313]: INFO cinder.volume.drivers.remotefs [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] casted to osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535 Sep 07 02:38:45 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a 1073741824 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:45 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a 1073741824 Sep 07 02:38:45 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:46 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a 1073741824" returned: 0 in 0.401s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:46 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a Sep 07 02:38:46 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:46 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'} {{(pid=87313) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1c2c91-8ae8-47e0-b2b0-ce865543a8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-778c1887-0f3e-40f6-8005-cd852781bf9a', 'volume_size': 1}' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb38a300-a808-44e0-8811-d422344eebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 02:38:46 devstack cinder-volume[87313]: INFO cinder.volume.flows.manager.create_volume [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Volume volume-778c1887-0f3e-40f6-8005-cd852781bf9a (778c1887-0f3e-40f6-8005-cd852781bf9a): created successfully Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb38a300-a808-44e0-8811-d422344eebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87313) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Flow 'volume_create_manager' (b3a5bc31-ccce-4b79-a0b4-aff9f387cf85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87313) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 02:38:46 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-75eb5556-7746-4cea-95d4-a8fb73ab15c6 tempest-ProjectReaderTests-1553224857 None] Created volume successfully. Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] Creating offline snapshot 58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 of volume 778c1887-0f3e-40f6-8005-cd852781bf9a {{(pid=87313) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69c6eb0-347c-4304-b561-929fa6f9a4ca]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:46 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:47 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a Sep 07 02:38:47 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:47 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a" returned: 0 in 0.351s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 1G {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:47 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 1G Sep 07 02:38:47 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:47 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 1G" returned: 0 in 0.386s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-778c1887-0f3e-40f6-8005-cd852781bf9a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:47 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-778c1887-0f3e-40f6-8005-cd852781bf9a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 Sep 07 02:38:47 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:47 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-778c1887-0f3e-40f6-8005-cd852781bf9a -F qcow2 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05" returned: 0 in 0.287s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:47 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 is being set with open permissions: ugo+rw Sep 07 02:38:47 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:48 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 Sep 07 02:38:48 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:48 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05" returned: 0 in 0.239s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:48 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.info Sep 07 02:38:48 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:48 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.info" returned: 0 in 0.249s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:48 devstack cinder-volume[87313]: WARNING cinder.volume.drivers.remotefs [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.info is being set with open permissions: ugo+rw Sep 07 02:38:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.info {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:48 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.info Sep 07 02:38:48 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:48 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.info" returned: 0 in 0.244s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:48 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:48 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-d5e03f53-118b-4901-ac3c-9d2c60d98bde tempest-ProjectReaderTests-1553224857 None] Create snapshot completed successfully Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-58b9dedd-fd2a-46fa-ad43-035fb3c7bd05-delete_snapshot" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-58b9dedd-fd2a-46fa-ad43-035fb3c7bd05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-778c1887-0f3e-40f6-8005-cd852781bf9a" by "delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-778c1887-0f3e-40f6-8005-cd852781bf9a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-58b9dedd-fd2a-46fa-ad43-035fb3c7bd05" by "_delete_snapshot" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-58b9dedd-fd2a-46fa-ad43-035fb3c7bd05" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Deleting offline snapshot 58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 of volume 778c1887-0f3e-40f6-8005-cd852781bf9a {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] snapshot_file for this snap is: volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 {{(pid=87313) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b51832-f7a1-4b96-a9a6-12eef0cb55f9]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:49 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 Sep 07 02:38:49 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:49 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05" returned: 0 in 0.359s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.remotefs [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-778c1887-0f3e-40f6-8005-cd852781bf9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87313) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[7008e492-6867-4a7e-b481-80f602825ad8]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:49 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a Sep 07 02:38:49 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:49 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a" returned: 0 in 0.345s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:49 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:49 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 Sep 07 02:38:49 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:50 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05" returned: 0 in 0.323s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:50 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05 Sep 07 02:38:50 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:50 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:50 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a.58b9dedd-fd2a-46fa-ad43-035fb3c7bd05" returned: 0 in 0.232s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-58b9dedd-fd2a-46fa-ad43-035fb3c7bd05" released by "_delete_snapshot" :: held 1.348s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-778c1887-0f3e-40f6-8005-cd852781bf9a" released by "delete_snapshot" :: held 1.369s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:50 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Created reservations ['3af2e589-3c07-45d8-81c8-b5e658c7cf39', 'a5ae35b6-3b41-40ad-8ef0-f3ab1e9c887f', 'ec48c4d3-9ca0-4e61-983b-2867e838ac8f', 'af8bc8e8-ba2b-4abb-b665-47c4f28665dc'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:50 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Delete snapshot completed successfully. Sep 07 02:38:50 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-1a6e0280-d03b-4918-91ed-1748a746103a tempest-ProjectReaderTests-1553224857 None] Lock "cinder-58b9dedd-fd2a-46fa-ad43-035fb3c7bd05-delete_snapshot" released by "delete_snapshot" :: held 1.492s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-778c1887-0f3e-40f6-8005-cd852781bf9a-delete_volume" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-778c1887-0f3e-40f6-8005-cd852781bf9a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "cinder-quobyte-778c1887-0f3e-40f6-8005-cd852781bf9a" by "delete_volume" {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 02:38:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-778c1887-0f3e-40f6-8005-cd852781bf9a" acquired by "delete_volume" :: waited 0.015s {{(pid=87313) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 02:38:51 devstack cinder-volume[87313]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a4cac4-0799-4423-959a-b7e8fbc0a2a9]: (4, 'qcow2') {{(pid=89020) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 02:38:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:51 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a Sep 07 02:38:51 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:51 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a" returned: 0 in 0.353s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:51 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a Sep 07 02:38:51 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:51 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:51 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd/volume-778c1887-0f3e-40f6-8005-cd852781bf9a" returned: 0 in 0.243s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:51 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-quobyte-778c1887-0f3e-40f6-8005-cd852781bf9a" released by "delete_volume" :: held 0.648s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:38:51 devstack cinder-volume[87313]: DEBUG cinder.quota [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Created reservations ['eab01955-dafa-4eff-a7ef-31b800407741', 'b829bbdb-d2dd-410e-9c46-b05f0de7668c', 'fbbea646-950e-43ca-9a61-0e040381c190', '82a53d62-d6a8-4de3-b481-448100a7b166'] {{(pid=87313) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 02:38:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 02:38:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 02:38:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535': None} {{(pid=87313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 02:38:52 devstack cinder-volume[87313]: DEBUG cinder.volume.drivers.quobyte [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ea02a4d5-babc-4fc8-aeef-9988353de535'] {{(pid=87313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 02:38:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.lockutils [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87313) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 02:38:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 02:38:52 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd Sep 07 02:38:52 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 02:38:52 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 07 02:38:52 devstack cinder-volume[87313]: DEBUG oslo_concurrency.processutils [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5360f48d33f51629968ca798138491fd" returned: 0 in 0.246s {{(pid=87313) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 02:38:52 devstack cinder-volume[87313]: DEBUG cinder.manager [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Notifying Schedulers of capabilities ... {{(pid=87313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 02:38:52 devstack cinder-volume[87313]: INFO cinder.volume.manager [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Deleted volume successfully. Sep 07 02:38:52 devstack cinder-volume[87313]: DEBUG cinder.coordination [None req-7f7ebad3-ba74-4fc0-9885-c463a668bb33 tempest-ProjectReaderTests-1553224857 None] Lock "cinder-778c1887-0f3e-40f6-8005-cd852781bf9a-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87313) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 02:39:02 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=16,cinder:INSERT=4,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 02:39:02 devstack cinder-volume[87313]: DEBUG dbcounter [-] [87313] Writing DB stats cinder:SELECT=100,cinder:UPDATE=121,cinder:DELETE=7,cinder:INSERT=34 {{(pid=87313) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}